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Image  correlation,  or  "map  matching,"  has 
important  implications  for  autonomous  target 
acquisition  and  terminal  guidance  for  various 
missiles,  as  well  as  for  other  pattern  recog- 
nition applications.  This  report  makes  the 
following  contributions  to  image  correlation: 
(1)  Analysis  of  block-substitution  effects 
(snow,  shadows,  clouds,  and  the  like)  on  the 
probability  of  correlation.  Pc,  (2)  Develop- 
ment of  a closed-form  approximation  for  com- 
puting Pc,  (3)  New  techniques  for  calculating 
the  inherent  scene  characteri sties  (numbers 
of  independent  elements  in  the  scene  and  tne 
scene  correlation  length),  (4)  A comoletely 
new  procedure  for  estimating  the  value  of 
Pc  from  the  correlation  data  themselves,  and 
(5)  A new  technique  for  selecting  and  ’ocati'  g 
the  s igr.’t leant  fe=tures  in  a scene.  (Author) 
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i’KK  FACE 


The  work  described  in  this  report  was  done  under  the  Project  ATR 
FORCE  (formerly  Project  RAND)  study  effort  entitled  "Target  Acquisi- 
tion." The  specific  subject  is  "map  matching,"  or  image  correlation, 
to  achieve  autonomous  target  acquisition  and  terminal  guidance  for  vari- 
ous missiles.  The  report  updates  and  supplements  two  recent  Rand  pub- 

•k 

lications  on  the  same  subject,  and  some  familiaritv  on  the  part  of  the 
reader  with  those  publications  is  presumed.  This  research  should  be 


contractors  who  are  concerned  with  technical  aspects  of  air-to-ground 
.attack,  as  well  as  others  working  in  the  basic  field  of  image  correla- 
tion. 
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Tli i report  makes  the  following  contributions  to  image  correlation: 

1.  Analysis  ot  block-substitution  effects  (snow,  shadows,  clouds, 
and  the  like)  on  the  probability  of  correlation,  P . 

2.  Development  ot  a closed-form  approximation  for  computing  1’  . 

1.  Mew  techniques  for  calculating  the  inherent  scene  character- 
istics (number  of  independent  elements  in  the  scene  and  the 
scene  correlation  length). 

4.  A completely  new  procedure  for  estimating  the  value  of  1' 
f rom  the  correlation  data  themselves. 

5.  A new  technique  for  selecting  and  locating  the  significant 
features  in  a scene. 

Block-substitution  errors  result  when  portions  of  the  scene  to  be 
imaged  suffer  uniform  amplitude  errors  such  as  might  be  produced  by 
shadows  in  the  scene  or  snow  on  the  ground.  This  report  analyzes  the 
effect  of  this  class  of  errors  and  determines  the  degradation  in  P as 
a function  of  the  magnitude  of  the  amplitude  error  and  the  sizes  of  the 
sensor  and  reference  maps  involved. 

The  computation  of  I’  heretofore  has  involved  numerical  integration 
techniques.  The  immediate  consequence  of  the  approximation  technique 
developed  in  this  report  is  to  simplify  the  computational  work.  Addi- 
tionally, (1)  some  insight  has  been  obtained  into  the  variables  that 
contribute  most  significantly  to  improving  P ; (2)  it  has  become  easier 
to  implement  the  estimation  procedure  for  determining  P^  directly  from 
the  correlation  data;  and  ( ))  using  this  algorithm  may  enable  one  to 
identify  a priori  the  distinguishing  features  in  a scene. 

The  terminology  used  most  often  in  describing  the  statistical 
characteristics  of  a scene  include  one  of  several  definitions  for  the 
scene  correlation  length  and  the  number  of  independent  elements  in  the 
scene.  The  usual  one-dimensional  calculation  is  a primarv  limitation 
when  computing  t lie  correlation  length  for  area  applications.  The  new 
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technique  developed  in  this  report  works  backward  from  the  correlation 
data  to  calculate  the  number  of  independent  elements  in  the  scene — trim 
which  an  effective  correlation  length  can  easily  he  calculated.  The 
technique  was  verified  using  a randomly  generated  scene.  The  assump- 
tion of  Gaussian  statistics  in  these  calculations  also  proves!  reasonable 
representative  of  the  statistics  of  the  real  terrain  imagery  tested. 

The  heart  of  the  report  describes  a new  procedure  for  estimating 
the  P value  direct lv  from  the  data.  The  technique  again  works  back- 
ward from  the  correlation  data  to  estimate  the  scene  characteristics — 
i.e.,  the  number  of  independent  elements  in  the  scene,  the  variance  in 
scene  intensity,  and  the  signal-to-noise  (s/M)  ratio.  From  these  esti- 
mates of  the  scene  characteristics,  one  can  calculate  the  number  of  in- 
dependent displacement  positions  at  which  the  two  maps  are  compared  and 
the  variance  of  the  in-register  correlation  function.  With  these  esti- 
mates and  the  P closed-form  approximation,  one  can  compute  P directly. 

This  technique  was  tested  using  Monte  Carlo  simulations  with  real 
imagery.  In  these  simulations,  the  correct  match  point  was  identified 

in  all  cases  (P  STM1H.ATF.D  = 1).  Values  determined  using  the  estimation 
c 

technique  for  each  individual  correlation  experiment  varied  between 
0.K1  and  0.94.  Perhaps  even  more  importantly,  a separate  experiment 
was  set  up  wherein  two  different  maps  were  correlated.  Obviously,  for 
this  situation,  P S1M1JLATF.D  = 0.  The  estimation  technique  in  this 
case  produced  values  no  greater  than  0.24.  Thus,  the  estimation  tech- 
nique appears  to  be  capable  of  distinguishing  between  cases  where  the 
sensor  map  is  or  is  not  contained  in  the  reference  map. 

Finally,  a new  technique  for  selecting  and  locating  the  signifi- 
cant features  in  a scene  has  been  developed.  The  technique  is  based 

on  estimating  the  value  of  I’  for  a large  number  of  submaps  and  selec- 

c 

ting  those  submaps  (sets  of  points  constituting  the  "significant" 

features)  that  have  the  greatest  effect  on  the  value  of  P . An  ex- 

c 

ploratory  computational  experiment  showed  sufficiently  encouraging  re- 
sults to  warrant  further  research  on  this  technique. 
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Tills  report  updnti's  previous  Rand  publications  on  i mage  correla- 

(1,2) 

t ion  and  describes  some  interesting  new  work.  To  provide  cont  inu- 

itv,  results  of  the  earlier  studies  are  reviewed  in  this  section. 

The  first  major  conclusion  was  that  an  approximate  lower  bound  on 
tin  probability  of  correct  target  acquisition,  P , can  be  calculated, 
so  that  we  can,  at  least  in  principle,  design  system;  to  meet  an  acqui- 
s i t i on  spec  1 1 i cat i on . 

Ouantitative  relationships  in  Kefs.  1 and  2 showed  the  dependence 
ot  1’  on  N (the  sensor  map  size),  M (the  search  area  or  reference  map 
size),  S/N  (nominally  the  s i gna 1-to-no ise  ratio  but,  more  importantly, 
i measure  of  the  fidelity  of  the  reference  map  vis  a vis  the  real-time 
sensor  map),  ind  various  parameters  describing  systematic  intensity  and 
geometric  errors.  Thus,  one  has  the  tools  for  carrying  out  design  trade- 
offs on  sensor  resolution  and  field  of  view  (to  increase  N)  , on  mid- 
course navigation  (to  decrease  M) , on  attitude  reference  and  guidance 
(to  reduce  geometrical  distortions),  on  data  processing  capabilities 
(to  reduce  both  synchronization  and  quantization  effects),  on  more  re- 
mit and  more  accurate  reference  data  (to  increase  the  S/N  ratio),  mil 
o on,  including  t inal Iv  a tradeoff  of  the  cost  of  increasing  the  P 

c 

requirement  Itself  with  the  loss  of  those  few  weapons  that  would  he 
wasted  if  they  achieved  a false  lock-on. 

Most  of  t I ese  relationships  for  P were  derived  from  a simple 
(Tausslan  theory  that  is  known  to  he  unrealistic.  Fortunately,  however, 
this  theory  appears  to  err  on  the  conservative  side — most  scenes  are 
more  distinctive  than  assumed  and  results  are  better  (i.e.,  v i e 1 d fewer 
gross  errors)  than  predicted.  On  the  other  hand , real  systems  have  ad- 
ditional error  sources  that  were  not  analyzed  or  simulated.  Neverthe- 
less, tiie  important  point  is  that,  witli  a "floor"  established  for  P , 

c 

there  should  lie  no  major  surprises  in  future  flight  tests  of  image- 
corn-  lat  i on  hardware.  Improvements  in  the  theory,  and  additional  data 
from  simulation  experiments  using  specific  scenes  of  interest,  are  ex- 
pected to  improve  the  predictions  and  relax  some  of  the  design 


I 


constraints.  1 'ne  • design  to  P requirements,  tliotip.fi  at  the  moment 
not  as  effectively  as  is  desired. 

i i >1  iclusi  i tin  following:  First,  since  a 

review  ot  the  theory  showed  that  none  of  the  commonly  used  algorithms 
is  necessarily  optimum  (all  are  approximations  to  a definable  but  un- 
attainable ideal),  we  are  free  to  look  for  other  algorithms  and  new  ap- 
proaches; and  second,  since  the  best  way  to  avoid  false  locks  is  to 
provide  a high  S/N  ratio,  and  since  one  way  of  achieving  a high  S/N 
ratio  would  he  to  enhance  the  characteristic  features  in  a scene  and 
throw  awa\  the  rest  of  the  data  (which  contributes  mostly  noise),  a 
deliberate  effort  to  search  out  the  unique  or  distinctive  features  in 
any  scene  might  In'  highly  desirable. 

We  do  not  know  at  this  time  how  to  extract  the  "characteristic 
features"  or  invariant  properties  of  a scene — those  least  likely  to 
change  with  time  or  environmental  conditions  and  therefore  most  likelv 
(in  this  context)  to  lead  to  high  values  of  the  signa 1-to-noise  ratio. 
However,  the  discussion  of  error  sources  in  Sec.  Ill  of  Ref.  1 made  it 
clear  that  the  useful  information  resides  more  in  the  geometric  rela- 
tionships than  in  the  intensity  or  signal  amplitude  dimension  of  an 
image.  Absolute  intensity  levels  are  the  least  dependable  quantities, 
and  intensity  ratios  and  even  the  algebraic  sign  of  differences  (con- 
trast) or  gradients  are  unreliable.  But  the  locations  of  most  intensity 
boundaries  are  fixed,  subject  only  to  certain  geometrical  distortions 
that  are  (a)  limited  in  magnitude  (largely  controlled  by  the  system 
design)  and  (b)  constant  or  slowlv  varying  over  a given  image. 

In  particular,  it  was  suggested  that  techniques  currently  being 
developed  in  the  field  of  pattern  recognition  should  be  explored  and 
exploited  for  this  purpose.  These  might  even  include  some  of  the  com- 
plex, heuristic,  upward  and  downward  directed,  hypothesis-testing  tech- 
niques used  in  so-called  artificial  Intelligence  programs.  But  also, 
at  least  for  the  present,  one  should  not  rule  out  completelv  the  use  ot 
people  to  examine  the  reconnaissance  imagery  and  pick  what  "look  like" 
good  features,  followed  by  the  selection  on  a specific  ad  hoc  basis  of 
"filters"  or  special  image-processing  algorithms  appropriate  to  each 


r 


. 

1 

I scene.  In  any  case,  the  on-board  processing  would  then  consist  of  ap- 

plying on  1 v the  selected  filters,  looking  solely  for  those  features 
known  to  be  significant  in  that  weapon's  assigned  target  area,  followed 
(presumably)  by  a simple  correlation  or  pseudo-correlation  algorithm 
for  locating  the  match  point.  It  is  anticipated  that  in  this  way  al- 
gorithms more  efficient  than  those  in  practice  to  date  will  evolve,  and 
that  at  the  same  time  higher  values  of  P will  result.  To  sum  up,  the 
suggestion  was  made  (independently  of  similar  prior  suggestions  hv 
others)  th.it  emphasis  might  well  he  shifted  away  from  schemes  that  com- 
pare every  picture  element  (pixel)  in  the  reference  and  sensor  Images 
to  searches  for  ways  to  extract  the  invariant  and  "distinct  ive"  features 
in  any  given  scene. 

It  must  he  pointed  out  that,  despite  the  strength  of  the  foregoing 
suggestion  for  a change  in  research  direction,  it  has  not  been  demon1- 
strated  that  the  feature-extraction  route  is  the  "only"  way  to  go.  For 
the  foreseeable  future  it  will  he  expensive,  and  ad  hoc  solutions  may 
have  to  be  found  for  almost  everv  scene;  and  there  may  he  manv  scenes 
and  conditions  for  which  one  or  more  of  th»  conventional  correlation 
systems  will  suffice.  For  the  time  being,  probably  both  courses  should 
he  pursued;  but  we  that,  in  order  to  . b.ieve  a multi-spectral 

capability,  the  future  lies  in  feature  extraction.  It  may  lie  even 
further  in  the  direction  of  pattern  recognition  per  se,  as  differenti- 
ated from  conventional  correlation  with  images  reduced  through  feature 
extraction;  hut  clearly  that  choice  cannot  be  made  at  this  time. 
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Whenever  cont  iguous  areas  suffer  uniform  amplitude  error  , ihea 

: ir<  referred  to  as  block  substitutions.  Shade iws  due  to  i alter* 

low  clouds  or  > halites  in  sun  angle  can  cause  dar)  blocks,  and  interven- 
in'.: -unlit  i loud?  and.  certain  kinds  of  jamming  ran  produce  bright  bloc!:. 
If  onlv  one  type  ot  error  is  treated  at  a time,  such  blocks  can  be 
characterized  by  just  two  parameters — >,  the  average  (constant)  ampli- 
tude of  the  signal  in  the  blocks,  and  , the  fract  ion  ol  the  total  area 
t hat  is  so  affected. 

In  general,  these  errors  have  two  effects  on  the  image  correlation, 
first,  onlv  t lint  portion  ot  the  sensor  map  which  i-.  not  changed  con- 
tributes to  the  correlation  peak.  Hence,  the  absolute  value  of  the  dif- 
ference between  the  in-register  and  out-of-register  values  of  the’  cor- 
relation function  should  he  reduced  bv  the  fai  t or  1 - . Second,  the 

pixels  that  are  changed  effectively  add  a significant  amount  of  "noise" 
into  the  correlation.  These  effects  can  be  analvzed  quant itat ivel v, 
following  the  general  procedures  elescribed  in  Kef.  1,  bv  calculating 
tin  expected  value  and  the  variance  for  the  in-  and  out-of-register  cor- 
relation I unction  as  functions  of  c and  . and  then  computing  P Kv 

’ c 

integrating  the  following  expression  [identical  to  Kq.  (4)  of  Kef.  1) 
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where  w is  ! - , erf  is  the  error  fund  ion  (see  lootnote  on  p.  14), 

o o 

O is  (lie  number  of  possible  out-of-reglster  posit  ions  of  the  sensor  map. 


and  tin1  statistical  quan  t i t i es  ( , : , , , mil  ,)  can  Sc  shown  to  * iv« 

o 1 o 1 

the  values  given  in  Tables  1 and  2 lor  the  I’roduct  md  MA I > (mean  abso- 
lute d i ! ter  ence ) algorithms,  respectively. 

A rather  large  number  of  numerical  cases  have  been  evaluated.  Two 
values  of  were  used:  zero  (with  no  noise  added,  possibly  simulating 

a shadow)  and  1 (roughly  the  maximtr  irnal  level,  with  'carious 
x 

amounts  of  noise  added,  to  represent  the  second  category).  Several 

values  of  have  been  used,  typically  0.  1 , l.  l,  fl.S,  and  up  to  0.7. 

Typical  results  are  summarized  in  Figs.  1 through  4.  Figures  1 and  2 

show  the  dependence  of  1’  on  both  i and  , and  Figs.  1 and  4 show  more 

dearie  the  -dependence.  As  would  be  expected,  increasing  decreases 

h , and  the  effects  are  always  worse  when  t deviates  from  zero  (the 
c 

mean  value  of  the  signal). 

Several  specific  ■ ases  have  been  extracted  ind  listed  in  Tables  1 

through  ' to  illustrate  the  following  points.  With  the  MAD  algorithm, 

the  1’  achieved  when  Mo,  V institutions  are  present  is  always  less  than 
i c 

if  the  unci  inged  sensor  elements,  N'(l  - •)  in  number,  were  the  only 
elements  affect  in.'  the  correlation  process;  that  is  to  sav,  the  addi- 
tional noise  Introduced  still  further  degrades  I’  . For  the  I’roduct 

c 

algorithm,  the  changed  blocks  do  not  contribute  anything  additional  to 
the  noise  when  the  intensity  level  is  equal  to  the  mean  ( ( = 0);  in 
that  case  the  reduction  in  the  number  of  operative  pixels  is  the  only 
effect.  However,  as  t deviates  from  the  mean,  the  additional  noise  ef- 
fects are  again  evident  in  the  last  column  of  Table  b.  Finally,  for 
low  S/N  ratios  (i.e.,  high  noise  levels),  this  additive  noise  effect  is 
not  very  significant;  hut  as  S/N  increases,  especially  when  S/N  >>  1, 
the  added  noise  decreases  V markedly,  as  seen  particularly  from  the 
last  entries  in  Tables  ) and  4. 

For  completeness,  the  simulation  results  from  Ref.  1 are  repeated 
here  in  Table  7.  As  expected  and  as  predicted  by  the  analysis,  degrada- 
tion increases  with  increasing  size  of  the  substituted  blocks  and  with 
deviation  of  the  substituted  value  from  the  signal  mean.  It  also  de- 
i pends  somewhat  on  scene  type.  Finally,  the  Normalized  Product  algorithm 

(Nl’rod)  Is  much  more  resistant  to  large-block  substitution  errors  than 
is  the  MAH  algorithm,  particularly  in  the  case  of  shadows;  hut  both  are 
seriously  degraded  in  the  presence  of  large  amounts  of  lamming. 
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RELEVANT  ENSEMBLE  STATISTICS  FOR  PRODUCT  ALGORITHM 
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RELEVANT  ENSEMBLE  STATISTICS  FOR  MAD  ALGORITHM 
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The  effects  on  Pc  of  a variation  in 


Fig.  3 — The  effects  on  Pc  of  a variation  in  0 : 
MAD  algorithm 
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Fig.  4 — The  effects  on  Pc  of  a variation  in  ft  : 

Product  algorithm 
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Table  ) 


ITTT  CTS  OF  H LOCK  SUBSTITUTIONS  ON  I1 
MAI)  ALGORITHM,  i = 0 
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Table  A 

FFFFCTS  OF  BLOCK  SUBSTITUTIONS  ON  I 
MAI)  ALGORITHM,  ot  = 3o 
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Table  5 

F.Fl  ' 01  BL0C1  ■:  B 1 \ ' I >N!  >N  ; : 

PRODUCT  ALGORITHM,  « 0 
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Table  b 

l.m.CTS  OF  BLOCK  SUBSTITUTION’S  ON  P : 
PRODUCT  ALGORITHM,  < = 3a 
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Table  7 

9 

EFFECT  ON  (.l.KTAIN  BLOCK  Sl'BSTITUTION  ERRORS  ON  THE 
PROBABILITY  OF  CORRELATION 

(Noise  added  to  sensor  scene,  S/N  = ),  N = 100,  0 = 1-0) 
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III.  A ( LOSKD-FORM  APPROX  I MAI  ION  ; 


The  most  important  new  development  In  the  Rand  study  following  puh- 
1 ication  oi  Rel  . 1 and  ' has  been  the  generation  oi  in  ipproxin  ite  ex- 
pression for  computing  P in  closed  form.  The  immediate  consequence  of 
this  approximation  is  to  simplify  the  computational  effort  in  obtaining 

1'  . Additionally,  there  have  been  three  other  consequences.  First, 
c 

we  have  pained  some  insight  into  the  variables  that  contribute  most 
significantly  to  improving  P , as  described  below.  Second,  with  this 
simplified  i losed— form  expression,  it  becomes  a much  easier  task  to 
estimate  t tie  valui  of  P , in  real  time,  directly  from  the  correlation 
data.  This  latter  point  is  discussed  in  the  next  section.  Third,  the 
use  of  P may  lead  to  a method  for  identifying  a priori  the  most  dis- 
tinguishing  features  in  a scene.  This  is  discussed  in  Sec . v of  this 
report . 


It  has  been  shown v that  the  integral  that  must  be  evaluated  (hv 
numerical  techniques)  in  determining  P^  for  correlation  algorithms  is 
of  the  general  form: 


f ± 

.■>,  ( ) 

['« • • 

•rf  (A/  + H ) <17.  ( 

J ■ J 

J 

a I gor i i hm 


For  a maximizing  algorithm  (e.g..  Product)  the  positive  sign  in 
front  of  the  erf  is  used  and  for  a minimizing  algorithm  (e.g.,  MAP)  the 
negative  sign  is  used.  Note  also  that  throughout  this  section  the  error 
function  is  defined  as: 


•r  l (•/.) 


J 


-x  /2 


whereas  in  Ref.  1 and  in  Sec.  11  of  this  report,  it  is  defined  as 


• r I CO 


r 


-lr>- 


where  A - ( U ) 

•(-1) 

_ = k <■;(»)  - Jj  J_(J_)_ 

o(.I) 

0 = total  number  of  d isp  1 acement  positions  (excluding  t lit*  match 
position)  at  which  the  sensor  and  reference  map  are  compared 
I ; ( )|,  r (.1)  , (0) , i(.l)  = ensemble  statistics  (dependent  on  the 

algorithm  choice  and  the  S/N  ratio). 

An  approximate  technique,  t iken  f r ef.  ),  has  been  suggested 
bv  !!.  . ess<  ly  >1  Rand.  The  essence  of  tl  technique  1 > to  approxi- 

mate the  quantity 

I (X)  I I / 1 • erf  (AX  + K)  |"  (1) 

contained  in  F.q.  (?)  by  a step  function.  Thus,  this  function  (for  a 
maximizing  algorithm)  will  be  replaced  bv 

for  7 > 7. 

o 

for  7.  < X 

o 

The  rationale  for  this  approximation  i>  that  for  large  values  of 

')  and  A (which  are  normal  in  the  cases  of  greatest  interest),  F(7) 

transitions  between  its  extreme  values  of  zero  and  one  fairlv  rapidly 

in  a continuous,  nondecreasing  manner.  The  transition  point,  7.  , car. 

be  found  by  setting  P(Z  ) equal  to  a halt  and  solving  for  7.  . 

o o 

Thus, 


1(7.) 


I1 

l<> 


/. 

() 


( ')  erf  1 [( 1 / J ) 1/(1  - (1/J)]  - _B 
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(max 
mi  n 


1 1 gor i t hm 
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Def in ing 
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anil  subst  I tut  ing  into  I < j . (4)  yields 


/. 
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The  quite  intractable  integral  in  Kq.  (2)  is  I Inis  reduced  to 
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( nia  •< 
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: • o r i l I i m ) 
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which  is  readily  evaluated  to  yield 


I’ 


i t i 
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’ ri.  i :■ 

, m i n 


1 1 i or  i t hr 


(8) 


Table  8 compares  the  approximate  values  obtained  for  1’  (us ing 
T.q . (8)]  with  the  exact  values  [using  Kq.  (2)]  for  the  MAI)  and  Product 
algorithms.  The  approximation  looks  good  for  values  of  i as  low  as  100, 
which  is  typically  the  minimum  number  that  would  be  used  in  any  correla- 
tion process.  Table  9 lists  the  values  of  A and  ti’  ( b * = B/tdl)  obtained 

for  these  algorithms  as  a function  of  the  S/N  ratio.  As  can  be  seen 

2 

from  Kq.  (3)  and  plots  thereof,  the  larger  tiie  value  of  A (where  A~  is 

the  ratio  of  the  in-  and  out-of-register  variances),  the  better  is  the 

step  function  approximation  for  F(/,).  The  greatest  deviations  between 

exact  and  approximate  values  of  P do  not  appear  to  result  from  using 

small  values  of  Q so  much  as  from  small  values  of  A. 

Larger  deviations  between  exact  and  approximate  values  for  P can 

c 

be  seen  in  Table  8 for  the  MAD  .algorithm  with  S/N  ratios  for  which  A is 
less  than  0.5  (S/N  = 10  and  S/N  = 30).  However,  even  for  values  of  A 
as  low  as  computed  in  Table  9 (A  = 0.13),  the  approximation  is  still 
not  too  had.  Since  A is  computed  in  the  process  of  approximating  P 
by  Kq . (8),  it  can  also  serve  as  an  Indicator  of  how  well  the 

Limits  to  /,  for  a min  algorithm. 


Table  H 


COMPAK I SON  OF  EXALT  AND  APPROXIMATE  VALUES  POP  P 
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c 
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approx im.it i on  will  match  the  exact  value.  As  t rule  of  thumb,  the  Mata 
indicate  that  values  of  A probably  as  low  is  t.l  would  yield  reason- 
able approximations  to  the  exact  value  of  P . 

Table  9 

VALPFS  OF  A AW  B'  FOP  Till  MAP 
AMP  PROPPCT  A1.00R  1T1IMS 


Produc t 

X1AP 

S/N 

A 

B' 

A 

B' 

0.  1 

1 .04 

0.  1" 

0.90 

-0.115 

1 .0 

1.22 

0.71 

0.  18 

-0.5b 

in.n  i 

1.18 

0.05 

(\  2 2 

-1.04 

10.0 

1.40 

0.O8 

| -1.15 

NOTE:  B'  = B/»/N  and  M = number 

of  sensor  map  elements. 


In  i'q.  (8),  the  ratio  A is  a function  of  the  S/N  ratio  only, 
whereas  the  variable  B is  a function  of  both  the  S/N  ratio  and  the  num- 
ber of  sensor  map  elements.  By  defining  a new  variable  B’  = as 

was  done  above,  Eq.  (8)  can  be  rewritten  in  terms  of  variables  that  are 
either  a function  of  only  the  S/N  ratio  (A  and  B')  or  the  number  of 
sensor  map  elements  (N) . 

I'  1/.’  U)  erf 
(' 


The  result  is 


[' ' ‘ !-**]  c:;;;  "—' ) 


(9) 


With  P expressed  in  this  form,  we  can  estimate  the  number  of 
sensor  elements  required  to  achieve  a given  1’^  level.  Solving  for  N 
in  terms  of  P and  the  other  variables  in  the  above  equation  yields 


( • ) K - A 


r t 
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One  must  recognize  tbit  this  approximation  solves  for  the  number  of 

■>  • sensor  elements  In  the  scene,  ami  that  the  number  of  pixels 
required  mav  he  several  times  the  nu  r of  elements  given  hv  this 
equation  to  achieve  a given  P level  it  there  is  any  spatial  correla- 
tion in  the  scene. 

Table  10  shows  the  value  of  N required  to  achieve  a P close  to 
unity  (P  - 0.99)  using  this  expression,  for  both  the  MAI)  and  Product 
algorithms.  Also  shown  in  this  table  is  the  value  of  N (taken  from 
Kei  . 1)  for  which  the  same  l’(  level  is  achieved.  The  approximation 
locks  reasonably  good  except  for  the  MAD  algorithm  cases  with  S/N  ratio 
equal  to  hi.  it  should  be  remembered  that  this  was  the  case  for  which 
the  approximation  for  P also  started  to  break  down  due  to  low  values 
f ' <■£  A . 

Thus  the  approximation  technique  can  great lv  simplify  the  P com- 

c 

putation  and  provide,  as  well,  a means  for  estimating  a priori  the 
number  of  sensor  map  elements  required  in  the  correlation  process  to 
achieve  a given  P level. 

Table  1') 

APPROX  1 MAT!  TI’MBER  OF  SENSOR  MAP  PI.FMFNTS  RF0P1RFD 
TO  ACHTFVE  Pc  = 0.99 

(k>  - 1()5) 


A 1 gor  i t tin 
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Returninp  to  If],  (M)  with  this  .ipproxim.it  ion  in  h ind,  it  i-  now 
possible  to  obtain  a deeper  insight  into  t lie  import  ;inre  of  rertain 
variables  and  their  interaction  in  t lie  correlation  process.  Since 
B'  — the  difference  between  the  in-  and  ont-of-res  i ter  exp*  ted  values 
of  the  correlation  function  normalized  t'  > < -his  the  same  s i t;n 
as  K,  Eq.  (9)  ar  hi  m 1 1 • it  i non  general  I n (independent 
whether  the  algorithn  is  maximizing  or  minimizing'  e 

r - 1/2  - erf  ({  ) ( 1 - h*  ) (11) 

xamin.it  ion  >f  this  expression  reveals  that,  to  ic'ieve  i I’  greater 
than  1/2,  it  is  necessary  that 


B ' ' K 


and  in  fact  that  r • Iml/ed  hv  minimizing  tlie  expression 


(12) 


1)1  • ) 


(13) 


Table  11  shows  some  computed  values  of  y and  l1  for  three  different 

algorithms.  As  seen  in  this  table,  minimum  values  of  y do  correspond 

to  maximum  !’  values  for  a given  S/N  ratio.  Several  additional  con- 
c 

elusions  can  also  he  tentatively  drawn  from  these  data  and  Fq.  (13), 
as  foil ows : 

1.  As  the  number  of  sensor  map  elements,  N,  increases,  the  value 

of  decreases.  This  results  in  an  increased  value  of  I’  . 

c 

2.  As  the  number  of  out-of-register  positions,  <),  increases,  t 

increases.  Mils  results  in  a decreased  value  of  1’  . 

c 

).  Since  A and  B'  are  both  dependent  on  the  S/N  ratio  and  tin- 
scene  characteristics,  no  universal  relationship  between  r 
and  these  two  variables  is  to  be  expected. 

4.  From  t tie  data  given  in  Table  11  it  appears,  over  the  S/?l  ratio 
region  examined,  that  tin-  algorithm  with  the  highest  absolute 
value  of  K'  also  achieves  the  minimum  value  of  y,  and  hence 


T 


I 


values  are  for  a Gaussian  scene  with  only  an  additive  noise  error. 


I 
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t lit*  maximum  value  of  P . Thus,  the  value  of  111*  can  serve 
as  a measure  of  the  "goodness"  of  an  algorithm,  where,  to 
repeat 

1 J 0 )J  I :j  I ) 

/N  ’ ( .1) 

5.  It  does  not  appear  from  the  data  in  Table  II  that  further  sub- 
opt inal  expressions  for  maximizing  P can  be  found  by  either 
maximizing  the  numerator  or  minimizing  the  denominator  of 

B'  . 

b.  It  should  also  be  noted  from  the  data  that,  over  the  S/N  ratio 

region  investigated,  minimizing  the  variable  y alone  does  not 

ma  x i m i z e P . 

c 

Reflection  on  the  physical  meaning  of  | li * 1 , as  described  at  the 
top  of  page  20,  makes  it  quite  clear  why  its  maximization  is  a good 
criterion,  why  suboptimization  of  its  parts  is  not  useful,  and  why  it 
is  far  more  efficient  as  an  estimator  than  the,  ratio  </ . 


/ 
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fV.  FSTTMATTON  TFCHNIQl'FS  USING  CORRFhATION  DATA 


Onp  concept  frequently  neglected  In  the  correlation  field  Is  the 
possibility  of  using  the  correlation  data  themselves  to  estimate  some 
of  the  important  parameters  of  the  process,  such  as  the  number  of  in- 
dependent elements  in  the  scene,  N,,  the  correlation  length  of  the 
scene,  i , the  signal-to-noise  ratio,  S/M,  and  the  probability  of  cor- 
rect lock-on,  !’  . 

c 

! here  are  two  methods  hv  which  one  could  obtain  these  estimates. 
First,  one  eight  develop  an  expression  for  the  statistical  properties 
of  the  correlation  process,  allowing  the  scene  to  be  spatially  cor- 
related with  anv  appropriate  distribution.  The  problem  here  is  that  it 
is  extreme'  difficult  to  develop  these  statistical  relationships.  How- 
ever, if  i 10'neral  solution  could  be  obtained,  accurate  estimates  could 
be  made  directly.  Tin*  other  method  would  be  to  assume  the  scene  to  be 
uncorrelated  and  Gaussian  distributed . The  statistical  expressions 
that  result  for  any  algorithm  are  generally  quite  simple;  however,  there 
Is  now  an  additional  unknown  quantity  that  needs  to  be  estimated — the 
number  of  Independent  elements  in  the  scene.  Any  spatial  correlation 
in  the  scene  will  result  In  a lower  number  of  independent  elements  than 
the  number  of  pixels  contained  In  the  sensor  map.  This  latter  method 
is  used  to  estimate  the  Important  parameters  of  the  process,  as  de- 
scribed below. 

KSTIMATINC  SCFNF  i’AKAMFTFKS  FROM  THF  CORRELATION  DATA 

To  illustrate  the  estimation  process,  let  us  first  assume  that  in- 
and  out-of-register  values  of  the  correlation  function  have  been  gen- 
erated. The  following  quantities  can  be  extracted  from  such  data,  where 
the  subscript  M indicates  quantities  derived  from  measured  data: 

<0(0)  = minimum  achieved  value  of  the  correlation  function  in- 
register 

^^•0  = average  measured  value  of  the  correlation  function  out- 
of-reg 1 ster 

2 

T^(.I)  * measured  variance  of  the  correlation  function  out-of- 
register 
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These  quantities  can  then  be  used  as  estimates  for  the  ensemble  sta- 
tistic. ! ■ ;(())  •,  V : (.1)  , and  ' (.I),  respectively.  The  quant  ity  '^.(0) 
cannot  be  estimated  from  these  data  since,  in  general,  tiiere  is  only 
one  observed  extremum  value.  Quantities  derived  using  these  assump- 
tions will  carry  a caret  ( ) over  the  symbol. 

For  the  i ./■  >>•'  t h"i  (assuming  an  uncorrelated , Oauss ian-d  i s- 

tributed,  zero-mean  scene),  the  estimates  of  the  statistical  measures 

2 2 

are  related  to  the  scene  characteristics,  o , o',  and  N , hv  the  follow- 
(1)  X ” 

ing  etjuations: 


,(() ) 


(14) 


. ( .1 ) 
M 


(JM<  1 > = (1 


N 


I 


(15) 

(16) 


where 


2 

x 

2 


variance  of  the  scene 
variance  of  the  noise 

number  of  independent  elements  in  the  sensor  scene. 


With  three  equations  and  three  unknowns,  one  can  thus  compute  esti- 
mates for  the  scene  parameters  from  the  measured  data.  Specifically, 

"n  = ("/2)  ;M(0)  from  rfl-  (1A)>  2”2  * <"/2)  I^U)  - ^(0)1 

from  Kqs.  (14)  and  (15),  and  the  formula  for  derived  from  Fqs.  (14), 
(15),  and  (16)  is 


(n/2  - I ) ;2(-l) 


(17) 


The  entire  procedure  is  diagrammed  in  Fig.  5.  The  two  maps  are 
first  correlated.  The  extremum  is  taken  as  the  in-register  value  of 


.4. 


J 


Estimation  of  scene  parameters  from  MAD  correlation  data 
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t he  correlation  function  anil  is  extracted  from  t lie  data;  the  first  tnd 
second  moments  of  the  out-oi -register  values  are  then  computed  from  tin 
remaining  data.  Based  on  these  moments,  the  extremum  value  of  the 
correlation  function,  and  the  correlation  statistics,  the  scene  param- 
eters are  estimated.  This  estimation  procedure  assumes  that  the  cor- 
relation statistics  for  the  MAI)  algorithm  are  Gaussian.  Obviously, 
most  scenes  are  not  truly  Gaussian  and  do  not  generate  purely  Gaussian 
statistics.  The  question  remains  as  to  how  close  to  Gaussian,  in  gen- 
era], are  typical  scene  statistics. 

A control  experiment  was  run  to  test  the  accuracy  of  the  parameter 
estimates  and  to  examine  the  validity  of  the  Gaussian  assumption.  The 
experiment  consisted  of  generating  a reference  mail  whose  elenents  were 
independently  Gaussian  distributed,  and  extracting  from  this  reference 
map  a 10  ■ 10  element  sensor  map  th.it  was  then  correl  ited  over  the  en- 
tire reference  map  using  the  MAI)  algorithm  in  the  absence  of  noise. 

_ a 

Based  on  the  out-of-register  correlation  data,  {.id)  and  ) were 

„ MM 

computed  and  Mj  estimated  using  Gq.  (17).  Table  J shows  the  result* 
of  tiie  estimation  process  using  25  different  reference  scenes,  each  of 
which  contained  15  x 15  elements.  Also  shown  in  tills  table  are  the 
values  of  the  third  and  fourth  moments,  and  u, , of  the  out-of-regis- 
ter  correlation  function.  For  a Gaussian  distributed  process,  the 
tiiird  moment  should  equal  zero  and  the  fourth  moment  should  be  three 
times  the  square  of  the  variance.  As  seen  in  the  table,  in  this  case 
tiie  process  is  reasonably  close  to  Gaussian.  These  moments  were  also 
calculated  for  real  scene  imagery  and  similar  results  were  found.  The 
correlation  length,  discussed  further  below,  can  be  defined  quite 
generally  by  the  relationship 


with  N = actual  number  of  sensor  elements  (pixels)  in  the  scene.  The 

A 

values  of  p given  in  Table  12  are  computed  from  Fq.  (18). 

Tiie  disturbing  result  of  this  experiment  is  that  the  average  value 
of  the  estimate  for  Nj  is  168  (which  is  much  larger  than  the  actual 
number  of  elements,  100,  from  which  the  scene  was  constructed)  and  that 


i — 

> 
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Table  12 

ESTIMATION  OF  i5  USING  MAI)  ALGORITHM  DATA 
(M  = 225,  N = 100,  Q = 35,  random  scene) 


Run 

Var  i am  <• 
(out  of 
reg i st or) 

l it  i rd 

Momen t 

M3 

— 

Four t n 

Moment 

M4/A.l) 

bat  i ina  ted  No  . 
ot  Independent 

1 1 emeu  t s 

N> 

Est i mated 
Cor re  1 at  ion 
Lengt  li 

1 

0.00424 

-0.00003 

2 . 32  5 

198.0 

0.822 

> 

0.00  3n  3 

0.00002 

2.933 

200.9 

0. 705 

3 

0.00307 

0.00001 

2.25  3 

2 38.  1 

0.64  8 

4 

0.00259 

-0.00259 

2.153 

288.  1 

0.589 

5 

0.004 39 

0.00015 

2.668 

148.  1 

0.8  22 

b 

0.00557 

-0.00015 

2.5  36 

137.5 

0.852 

7 

0.00747 

-0.00008 

2.465 

88.  7 

1 .062 

8 

0.00324 

-0.00014 

3.  826 

259.0 

0.621 

9 

0.00801 

0.00017 

2.052 

94 . 9 

1.027 

10 

0.00383 

-0.00002 

1.911 

200. 3 

0.70  7 

1 1 

0.00753 

0.00007 

2.  354 

117. b 

0.922 

12 

0 . 00  39  8 

0.00000 

2 .079 

144. 3 

0 . 8 32 

13 

0.00405 

-0.00002 

2 .6  79 

16  3. 1 

0.78  3 

14 

0.00532 

0.00001 

3.  380 

134 . 7 

0.862 

15 

0.00414 

0.00002 

2.621 

159.6 

0. 792 

lb 

0.00426 

-0.00017 

3.  139 

17  3.4 

0.760 

17 

0.00528 

-0.00000 

2.637 

134.5 

0.862 

18 

0 . 00  39  1 

0.00006 

2.574 

164.2 

0. 780 

19 

0.00415 

-0.00012 

2. 125 

215.1 

0.682 

20 

0.01144 

0.00009 

2.828 

83.2 

1 .096 

21 

0.00475 

0.0001 1 

2.406 

206.5 

0.696 

22 

0 . 00  34  7 

0 . 00004 

2.49  3 

2 39 . 9 

0 . 646 

23 

0.00656 

-0.0001 1 

2 . 2 86 

114.6 

0 . 9 34 

24 

0.00290 

-0.00009 

3.066 

2 50.0 

0.633 

25 

0.00680 

0.00003 

2.  317 

99.9 

1 .001 

Mean 

0.00498 

-0.00007 

2.564 

168.2 

0.805 

there  Is  a large  variation  In  the  range  of  the  estimate  (from  83  to 
228).  This  experiment  was  repeated  using  different  reference  map  sizes, 
with  similar  results.  The  hypothesis  was  put  forth  that  there  Is 
nothing  wrong  with  the  estimation  technique  per  se,  but  rather  that 
values  of  the  MAD  algorithm  computed  at  closely  spaced  displacements 
are.  In  fact,  correlated.  Such  a correlation  would  cause  the  variance 
of  the  map-correlation  function  to  be  somewhat  smaller  than  was 


a 


J 
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« .il, -ill, iii- ! by  tin  theorv,  t tins  leading  I n overestimation  of  N through 
F.q.  (17). 

lo  show  that  tint*  is  indeed  correlation  between  adjacent  values 
, t t he  com  ti  functioi  ei  tin  D ilgorithm  is  used,  .1  simple 
two-e 1 orient  sensor  nap  was  hvpot  lies i zed  and  correlated  over  adjacent 
• • • • • ■ ent  referenct  map.  rhe  ref erence  map  ele- 
ments, X , were  (.•!)-.  iderel  1 h«  independent  and  ident  Jcal  lv  distrib- 

2 * 

uted  It  . • ■ ■ . , a the  ensoi  el en ent s,  if., 

had  the  distribution  , . The  adjacent  correlation  functions  were 

t hen  dc‘ f i tied  to  be 


v 4 x - v d(0 

I 2 2 

- Y,  -4  X - V (70) 

I ' i 2 ' 


. K.  Chow  o t rhe  Rand  Corporation  has  determent  th<  covar ianci  be- 
t ween  these  two  functions  to  be 


i m I : M ) . :(.')! 


where 


H 


and 


Since  the  correlation  coefficient  between  these  two  functions,  :(1> 
and  ; ( 2 ) , is  given  by  the  covariance  of  the  two  functions  divided  by 
the  product  of  the  standard  deviations  of  each  (and,  in  practice,  the 


I’rivate  communieut  ion. 
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covariance  is  almost  never  equal  to  zero),  then,  in  general,  there  is 
correlation  between  these  two  adjacent  values.  Thus  Fqs.  (Ifi)  and  (17) 
tre  ' valid  for  the  determination  of  scene  parameters  from  MAH  cor- 
relation data. 

This  correlation  between  adjacent  computed  values  has  a further 
important  implication  with  regard  to  the  predicted  performance  of  the 
MAI)  algorithm.  Th.  reduction  in  the  out-of-reglster  variance  not  onlv 
leads  to  an  overestimate  of  N (as  mentioned),  but  also,  and  more  im- 
portant lv,  results  it  an  underestimate  of  P — hence  the  values  calcu- 
late. i In  the  past  for  the  MAI)  algorithm  are  all  too  conservative. 

Tor  the  /■  •'  (again  assuming  an  uncorrelated,  Gaus- 

sian—distributed,  zero-mean  scene) , the  estimates  of  the  statistical 
measures  ire  related  to  the  scene  characteristics  hv  the  following 

(D 

equat ions : 

• (0)  = a2  (22) 

M x 

T (I)  = 0 (23) 

M 


7 A)  ' 

«<■"  ( ;/n, 


(24) 


Since  Gaussian  theory  requires  the  average  of  the  out-of-register 
values  to  vanish,  the  second  of  these  equations  is  not  usable  in  solving 
for  the  scene  parameters;  hence  there  are  only  two  equations  with  three 

unknowns.  However,  in  the  noise-free  case,  i.e.,  in  autocorrelations 

2 ~ 
with  o = 0,  F.qs.  (22)  and  (24)  can  he  solved  for  N with  the  result 


N. 


*’m  (0) 

T2.  (■» 


(25) 


The  complete  process  In  this  case  is  diagrammed  in  Fig.  6. 
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Further  analysis  of  a two-element  sensor  map  shows  that  the  co- 
variance between  adjacent  values  of  the  Product  correlation  function 
is  zero,  indicating  (as  expected)  statistically  independent  values. 

Thp  experimental  results  shown  in  Table  I)  verify  this  analytical  pre- 
diction. The  average  number  of  independent  elements  over  all  refer- 
ence maps  is  close  to  100,  and  the  estimated  correlation  length,  de- 
fined bv  Fq.  (IH),  is  close  to  unity.  The  assumption  of  Gaussian 
statistics  was  again  tested  using  real-world  imagery  in  Product  correla- 
tion, and  the  result  was  again  reasonably  positive. 

In  the  past,  correlation  length  has  normally  been  computed  by 
determining  the  average  distance  over  a given  region  of  the  scene  at 
which  the  autocorrelation  falls  to  a value  of  17  percent  of  its  maxi- 
mum. This  process  is  complicated  when  applied  to  a two-dimensional  map 
because  of  the  multiple  directions  in  which  the  correlation  function 
can  be  computed.  The  estimation  method  presented  here  is  an  opera- 
tionally simpler  technique  for  determining  the  effective  correlation 
length  of  a scene.  This  technique  was  used  to  estimate  the  number  of 
independent  elements  and  the  correlation  length  in  four  regions  (agri- 
cultural, mountain,  desert,  and  suburban)  of  the  earth  resources  satel- 
lite data  base  described  in  Ref.  1.  Each  region  was  broken  down  into 
twenty-five  20  * 20  reference  maps.  The  Product  correlation  algorithm 
was  applied  to  each  of  these  twenty-five  subregions,  using  10  * 10  sen- 
sor maps,  and  an  estimate  of  the  number  of  independent  elements  and  the 
corresponding  correlation  length  in  each  subregion  was  obtained.  These 
estimates  are  shown  in  Tables  14  through  17  for  the  four  regions.  The 
average  values  of  the  correlation  lengths  in  each  of  these  regions  are 
summarized  below: 


Rollon  p 


Agr  icul t ure 

1.0 

Mount  .1 1 n 

2.7 

Desert 

2.0 

Suburban 

2.0 

Random  ( 1 rom  lab  1 e 

1 1) 

1 .0 
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Table  1 ) 

i'.ST  l HAT  ION  OF  Nj  AND  . USING  PRODUCT  ALGORITHM 


22  3,  N 

1(H),  q = 13 

, random 

1 ndi  pendeii  1 

( < ■ r (flat 

1. 1 e men  l s 

l.engt  ii 

eg  ion 

''  1 

>' 

104  .0  A 

0,98 

9 i . id 

1 .03 

* 

91 . 8H 

1 .04 

* 

74.  7 7 

1.16 

1 l'».  . I 

0 . 86 

(> 

99  . . 1 

1 .00 

* 

102.08 

0.99 

H 

0 . . H 

1.0) 

4 

9 l .22 

1 .03 

0 

90.7  1 

1 .03 

1 

127.31 

0.89 

10  l.s6 

0.98 

i 

116.23 

0.93 

4 

114.  12 

0.94 

9 3.91 

1.0) 

6 

92  . 1 i 

1.04 

7 

91.87 

1 .04 

8 

14  3. 66 

0.8  3 

y 

80.80 

1.11 

0 

86 . 20 

1 .08 

1 

83.  78 

1 .08 

J 

9 7.48 

1.01 

J 

123.43 

0.90 

'♦ 

111.13 

0.93 

3 

8 7.i) 

1.07 

i 

I 

t 

101.73 

1 

l .004 

FSTl MATING  TUI.  S/N  RATIO  FROM  THF  GOKRKI.ATION  DATA 

When  the  sensor  map  contains  extraneous  noise,  as  it  always  does, 
it  is  of  considerable  interest  to  estimate  the  S/N  ratio  directly  from 
the  correlation  data.  One  can  do  so  for  the  MAD  algorithm  by  solving 
for  estimates  of  and  o " using  Hqs.  (14)  and  (13)  and  then  taking  the 
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ratio — avoiding  t lie*  use  of  Eq.  (16),  since  N^  is  known  to  be  incorrect. 
Table  1H  shows  tlie  comparison  between  the  estimated  and  actual  S/N 
ratio  for  a 10  * 10  sensor  map  and  a 20  x 20  reference  map  taken  over 
various  regions  of  the  earth  resources  satellite  map.  The  estimate  is 
correct  to  within  about  15  percent  rms. 

A more  detailed  description  of  this  estimator  and  its  variance, 
and  analogous  results  for  the  Product  algorithm,  are  contained  in  the 
appendix. 


Table  18 


COMPARISON  OF  ESTIMATED  AND  ACTUAL  S/N  RATIOS 
USTNC,  THE  MAD  ALGORITHM 

(M  = 400,  N = 100,  Q = 120) 


Region 

S/N  (actual) 

S/N  (estimated) 

Agricultural 

0.  70 

0.61 

0.97 

1.04 

0.97 

1.02 

Mountain 

1 .07 

1.12 

0.96 

0.87 

0.92 

1.06 

Desert 

1.13 

0.9  5 

1.14 

0.80 

0.92 

0.  76 

Suburban 

0.95 

1.11 

1.12 

0.98 

1.02 

0.86 

Random 

0.99 

0.88 
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ESTIMATING  P FROM  THE  C0RREI.ATI0N  DATA 
c 

The  most  important  quantity  to  be  estimated  from  the  correlation 

data  is  the  degree  of  confidence  one  can  have  that  the  extremum  gives 

the  correct  matchpoint,  i.e.,  the  P associated  with  the  extremum. 

c 

Using  the  approximation  technique  developed  In  Sec.  Ill,  P can  be  ex- 

c 

pressed,  following  Eq . (11),  as 


- )b- 


i/:1 


.■rt 


1/  id 

|\  (0  ) 


ii  ■ ; (0  ) ■ - i.  : 

A 1)  i | 

i(  () 

< 2b  1 


where  K is  given  hy  Kq.  (5)  and  A and  B have  values  as  defined  following 
Eq.  (2). 

As  before,  the  value  of  the  extremum,  ,*^(0),  can  serve  as  an  esti- 
mate for  : (0)  . Similarly,  tiie  mean  value  of  ill  the  out-of-register 

_ i 

correlation  values,  l^(.J),  and  the  variance  of  tliese  value  , M 1 , 
measured  from  the  data  * serve  as  estimates  for  ’ Mi  and  1 ’ , 

: . ipectively.  In  order  to  estimate  1 , It  I s i ! 1 ! n<  - ii 

values  for  0( 0)  and  K In  Kq.  (2b).  The  exact  procedures  to  he  use 
differ  for  the  two  principal  algorithms. 

For  the  , tiie  crucial  step  is  tiie  generat  1 >r 

the  estimate  for  \'^  given  by  Kq.  (25),  which  was  obtainei  bv  pert  ; 
an  autocorrelation  on  tiie  reference  map.  Actually,  in  t b i s ro  «• 

is  using  tiie  values  of  and,  through  Kq.  (18),  of  tiie  effo<  t tve  ir- 

relation  length  measured  on  tiie  reference  map  as  estimates  t r t'> 
corresponding  quantities  on  tiie  sensor  map;  accordinglv,  one  should 
probably  perform  the  autocorrelation  on  the  sonsor-map-si/e  i p irti  • 
of  tiie  reference  centered  on  tiie  target,  or  a somewhat  larger  . ize.J 

portion,  hut  not  on  the  entire  reference  map. 

* 2 2 

Witii  N tiius  in  hand,  and  o and  determined  from  !qs.  < i and 
I x n 

(24),  one  can  proceed.  One  first  observes  that,  although  < ')  cannot 
he  obtained  directly  from  the  data  (since  there  is  ordinarilv  onlv  no 
extremum).  It  is  only  the  ratio  O(.T)/o(0)  that  occurs  in  Fq.  (.’b).  Nov 
02(J)  is  given  by  Kq.  (24)  and  <J2(0)  is  known  ^ ^ ^ to  be 
Thus  tiie  desired  ratio  is  simply 


0(.)) 

o(0) 


(27) 


wiilcii  involves  only  known  quantities 
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Secondlv,  from  I'.q.  (h),  K is  a function  only  of  ttu*  number  of 
nonmatching  displacements  for  which  the  correlation  function  is  evalu- 
ated. i'  in  turn  is  given  In  Kef.  1 (In  the  footnote  on  p.  7)  as 


<1  = ( m - n + 1 ) - I 


(2H) 


2 2 

where  m‘  - M is  the  reference  map  size  and  n = N is  the  sensor  map 

size.  Since  the  sensor  map  size  lias  been  scaled  down  hv  the  square  of 
tiie  correlation  length  to  use  the  statistical  relationships,  it  is  also 
necessary  to  scale  •)  similarly.  The  expression  for  the  number  of  in- 
dependent displacements,  <>  , is  therefore 

QI  y \J  \ ~ /N|  + 1 


Thus  (J  and  K can  also  be  estimated,  and  then  P using  Fq . (2b).  This 
complete  process  is  diagrammed  in  Fig.  7. 

For  the  " i .•  , the  ratio  o(J)/o(0)  can  be  found  by  a si-  i- 

2 2 (1) 

lar  process,  o (.1)  is  given  in  Kq.  (lb),  and  (0)  is  known  to  be 

(1  - 2/')  ( ,,/Nj).  Thus  the  desired  ratio  is 


' (J) 
o(0) 


(30) 


However,  K is  still  a function  of  Q-,  as  given  bv  Fq.  (20).  Since 
m n,  Qj  increases  monotonical ly  with  N^,  and  so  does  K bv  Fq.  (S); 
and  finally,  P(  decreases  with  increasing  K,  as  shown  hv  Fq.  (11)  or 
Kq.  (2b).  Thus  it  is  seen  that  the  previously  mentioned  fundamental 
difficulty  with  the  MAD  algorithm,  caused  by  the  partial  correlation  of 
adjacent  values  of  this  particular  function,  cannot  be  avoided.  The 
values  of  derived  from  the  equations  will  always  be  somewhat  too 
high,  and  the  resulting  predictions  for  P correspondingly  pessimistic. 
The  estimation  procedure  given  here  is  nevertheless  expected  to  be  suf- 
ficiently accurate  to  be  useful  under  many  circumstances,  and  is 


i 


diagrammed  in  full  in  Fig.  B.  The  inherent  difficulty  is  reflected  in 

A 

the  use  of  an  sign  with  F in  the  last  box  of  the  figure. 

An  experimental  simulation  of  the  estimation  process  has  been  run 

for  an  agricultural  region  of  the  earth  resources  satellite  map.  The 

MAP  algorithm  was  employed  to  investigate  t he*  degree  of  overestimation 

of  and  <1  and  the  underestimation  of  !’  . The  reference  map  size  was 
T c 

20  ■ 20  and  the  sensor  map  size  was  10  * 10.  Additive  noise  was  super- 
imposed on  the  sensor  map  such  that  the  S/N  ratio  was  approximately  1. 
Twenty-five  correlations  were  run  using  the  same  scene  and  different 
noise  samples.  For  this  scene,  N = 100  and  Q = 120.  Table  14  shows 
the  results  of  this  estimation  experiment.  For  all  25  runs,  the  cor- 
relation algorithm  (MAD)  correctly  matched  the  two  maps  (i.e.,  simu- 

A. 

lated  P =1).  P was  estimated  using,  first,  the  O derived  from 
c c I 

estimating  the  number  of  independent  sensor  map  elements,  as  given  hr 
F.q . (29),  and  second,  the  entire  number  of  map  matching  positions 
(Q  = 120),  where  no  attempt  was  made  to  account  for  correlation  in  the 
scene.  This  latter  approach  obviously  yields  a very  low  (conservative) 
estimate  of  , as  expected.  Although  the  former  approach,  P (0^),  is 
not  quite  right,  since  the  estimates  of  Nj  are  still  too  high,  the  esti- 
mates for  P are  reasonably  close  to  the  simulated  value  of  1.  The  S/\’ 
c 

ratio  and  the  correlation  length  were  also  estimated  in  this  experiment, 
and  the  values  are  included  in  Table  19.  Note  that  this  experiment 
(one  scene  with  25  different  samples  of  noise  added)  is  different  from 
that  in  Table  14  (25  different  scenes),  and  furthermore  that  the  ef- 
fective correlation  length  in  the  present  case  should  be  significantly 
less  than  that  in  Table  14  because  the  added  noise  is  completely  un- 
correlated . 

The  experiment  was  extended  by  examining  the  P^  estimates  when  t tie 
wrong  sensor  map  (a  map  not  extracted  from  the  reference  map  region) 
was  correlated  over  the  same  agricultural  region.  The  results  are 
shown  in  Table  20  with  two  different  noise  samples  added  to  make  t tie 
S/N  ratio  of  the  map  approximately  1. 

In  conclusion,  the  estimation  technique  appears  capable  of  yield- 
ing an  estimate  for  P^  from  a single  correlation  function  similar  to 
that  found  by  Monte  Carlo  methods  over  numerous  correlation  runs.  In 
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Table  14 

1ST  I MAT  ION  OF  Pc  FOR  AN  AORTniLTlIRAI.  RFC  I ON  OF  Tiff 
FARTH  RFSOORCFS  MAP 

(MAH,  M = 400,  N = 100,  0 = 120,  S/N  1) 


Kim 

Numlut 

N! 

1st  i mat  i'd 
< orri  l.it  ion 

1 engt h 

S/N 

1 

S/N  | 

(act  tin  1 ) 

1 

| 

w] 

P (t)  = 1 20) 

<* 

1 

>•  ’ 

7 .Ob 

0 . 4b 

1 .08 

5 5.2 

0.84 

0 . VJ 

7 7.8 

1 . 89 

0.98 

1 .01 

5H . 4 

0 . 47 

0.7  b 

5 

.}h . : 

1 . 9 4 

1.47 

1 .00 

!b  . 4 

0 . 

0 . r> 

4 

28.  h 

1 . Kb 

1.17 

0 . 97 

54  . 5 

0.9  7 

0 . 89 

4 

19.8 

2 . 7 4 

1.0  5 

0.91 

28.7 

0.8  5 

0.  >0 

h 

7b  . b 

1.9) 

1 .01 

0.97 

5b  . 9 

0.4  5 

0.  7b 

7 

7 1.8 

7 . 1 4 

1.47 

1 . Ob 

51.1 

0.48 

0.84 

H 

50.8 

1 .80 

0 . 84 

0.96 

41.9 

0.41 

0. 7b 

9 

7 4.8 

1 . 9b 

1.19 

1 .09 

5 4.4 

0.9b 

0.84 

10 

5 5.0 

1.75 

1.01 

0. 94 

...  i 

0.97 

0.90 

11 

7 4.  1 

1 . 99 

1 .49 

1 .04 

54.1 

0 . 99 

0.44 

12 

2 ) . h 

1.4/ 

1 .09 

0.47 

54.  7 

0.44 

0.7  7 

1 i 

7 7 . 4 

1 1 

1.18 

1.10 

57 .8 

0.47 

0.8  7 

14 

7 5 . b 

7 .04 

1 .04 

0.91 

5 5.1 

0 . 40 

0.67 

1 5 

74 . 9 

2.00 

I .02 

1 .04 

14 . 4 

0.41 

0.  70 

lb 

78.  7 

1 . 8b 

1 .07 

1 .01 

59.4 

0 . 4b 

0.84 

1 7 

29 . 1 

1 .84 

1.15 

0.4b 

54 . 9 

0.97 

0.88 

18 

29.2 

1 .84 

1 .08 

0.44 

40.0 

0.96 

0.8b 

1 9 

77.7 

1.91 

1.14 

0.97 

57.  7 

0.96 

0.84 

20 

79.4 

1 .8  5 

1.24 

0.94 

1 40.4 

0.48 

0.41 

21 

28.4 

1 .87 

1 . 10 

1 .07 

54. 2 

0.96 

0.8) 

22 

2 5.5 

7.07 

1 .04 

1.01 

52.9 

0.40 

(l.bb 

2 1 

79.7 

1 .81 

1 . 59 

1.01 

40.7 

0.94 

0.97 

24 

22 . 2 

2.12 

1 . 04 

0. 40 

51  .b 

0.8  7 

0.  b 1 

2r> 

29.0 

1 .84 

1.18 

0.4  4 

59. 7 

0.98 

0.90 

Mean 

2b.  7 

1 .94 

1.14 

0.94 

57.0 

0.44 

0 . 80 

addition,  comparison  of  Tables  19  and  20  indicates  that  the  estimation 
procedure  can  easily  distinguish  between  cases  where  the  sensor  map  is 
or  is  not  contained  in  the  reference  map. 


ADDITIONAL  PKKSPKCTIVK  ON  TUP  ESTIMATION  PKOCFSS 

Further  discussion  may  be  helpful  at  this  point  on  the  nature  of 
the  map-matching  process  and  the  significance  of  the  estimation  pro- 
cedures described  above. 
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Table  20 

KST IMATION  RESULTS  CORRKI.AT I N’G 
A WRONG  SENSOR  MAP  OVER  THK 
AGRICULTURAL  REGION 

(N  = 100,  Q = 120) 3 


"i 

/\ 

Q 

P (0) 

c 

P 

c 

(Q) 

49.1 

65.1 

0.225 

n. 

149 

48.5 

52.6 

0.215 

0. 

155 

a,.  i 

Sensor  scene  iloes  not  come 

from  reference  scent*. 


Consider  first  the  (auto)correlatlon  of  a single  sensor  map  with 
an  Identical,  noise-free,  reference  map.  The  distribution  of  values 
for  this  function  is  Indicated  schematically  In  Fig.  9A.  For  simplic- 
ity, a maximizing  algorithm  such  as  Product  is  assumed.  It  is  further 
assumed  that  a digital  calculation  is  performed  and  that  the  scene  is 
spatially  completely  uncorrelated,  so  that  the  value  at  the  match  point 
Is  essentially  a 6-function — otherwise  there  would  be  a small  one-sided 
tail  to  the  left  of  $(0).  In  this  case,  the  map-matching  process  is 
almost  trivial.  The  spread  in  the  out-of-register  distribution  func- 
tion is  determined  by  the  statistics  of  the  scene  itself,  a function  of 
and  Nj  as  given  by  Eq.  (22)  with  o = 0,  and  in  principle  this  can 
be  computed  beforehand  from  the  reference  map. 

Consider  next  the  introduction  of  noise — intensity  fluctuations 
or  prediction  errors,  geometrical  distortions,  real  changes  in  the 
scene,  all  the  causes  of  differences  between  the  two  maps — but  still 
assuming  a single  sensor  map  properly  centered  over  the  target  (i.e., 
with  perfect  midcourse  navigation).  The  distribution  of  values  of  the 
correlation  function  is  now  represented  in  Fig.  9B.  The  possible  cross- 
over of  the  tails  of  the  two  curves  demonstrates  the  possibility  of  a 

false  match  or  gross  error,  and  hence  the  need  for  calculating  P , the 

c 

probability  of  a correct  match.  This  quantity  can  be  calculated  fairly 

easily  if  the  distributions  are  assumed  to  be  Gaussian.  Since  a and 

x 

Nj  are  known  ahead  of  time,  in  this  case  the  observed  width  of  (j(J) 


f 


t- 


Fig.  9 — Distribution  of  values  of  the  correlation  function 
under  various  conditions 


-44- 


c ou Id  be  used  to  estimate  a , from  which  I’  can  he  found.  This  is  not, 

u c 

however,  the  real  operational  situation. 

Consider  finally  the  case  in  which  there  is  a midcourse  navigation 
error  and  the  sensor  map  may  he  any  one  of  a large  number  whose  center 
is  displaced  from  the  center  of  the  reference  map  (i.e.,  the  target) 
by  an  unknown  amount — an  amount  that  may  easily  be  large  enough  to 
cover  a portion  of  the  reference  map  having  different  statistical  prop- 
erties from  the  portion  immediately  adjacent  to  the  target.  In  this 
case,  one  is  concerned  with  the  ensemble  of  possible  sensor  maps.  The 
resulting  distributions  are  represented  in  Fig.  9C  by  the  artificial 

insertion  of  an  extra  "ensemble"  term,  o , in  the  variances.  It  is 

K (4) 

these  ensemble  distributions  that  were  analyzed  hy  Johnson,  and  ex- 

(2) 

tended  by  the  Rand  group,  in  terms  of  parameters  assumed  to  be  known. 
The  estimation  procedures  described  in  this  report  provide  a method 
for  drawing  from  the  observed  data  an  inference  concerning  the  distri- 
bution of  the  possible  extrema,  0(0).  This  inference  in  turn  permits 
the  best  possible  estimate  of  P to  be  made  before  the  fact,  i.e.,  on 
the  basis  of  the  correlation  statistics  obtained  with  a single  sensor 
map,  even  though  j>(0)  cannot  be  known  and  is  simply  estimated  by  t^(0). 

This  estimation  procedure  is  believed  to  represent  a new  contri- 
bution to  the  theory  of  image  correlation. 


i 


V. 
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INITTAI  WORK  IN  FFATURF  SFI-FCTION 

INTRODUCTION 

Previous  work  has  focused  on  area  correlation  per  so,  and  Ref.  1 
describes  in  considerable  detail  approaches  to  correlation  f ran  hot! 
theoretical  and  experimental  points  of  view.  It  seems  wise  at  this 
juncture  to  take  .1  broader  point  of  view  and  recognize  that  both  the 
incorporation  of  feature  selection  methods  from  the  field  of  pattern 
recognition  and  the  use  of  more  sophisticated  algorithms  can  improve 
the  map-ma tolling  process . Although  the  map-matching  prohlet  * ’ : • • I 

here  is  not  formulated  precisely  according  to  the  standard  pattern  rec- 
ognition paradigm  of  assignment  to  one  of  several  classes,  manv  con- 
cepts nevertheless  carrv  over  ind , in  particular,  the  techniques  of 
feature  extraction  are  relevant.  First,  however,  we  look  at  the  noise 
characterization  in  our  experiments,  because  this  is  important  in  as- 
sessing the  relevance  of  the  work  for  the  real  world. 

NOISK  IN  THE  MAI'S 

Most  of  the  experimental  work  described  in  Ref.  1 assumed  Caussian 
noise.  Although  useful  results  can,  and  did,  follow  from  this  assump- 
tion, it  is  appropriate  to  look  at  noise  that  Is  more  representative 
of  that  found  in  the  real  world.  This  Is  accomplished  when  a reference 
map  is  derived  from  reconnaissance  imagery  taken  in  one  region  of  the 
spectrum  (e.g.,  aerial  photography ) and  the  sensor  operates  in  a dif- 
ferent region  (e.g.,  infrared  or  radar).  In  such  eases,  the  major 
source  of  "noise"  resides  in  erroneous  predictions  of  the  intensities 
placed  In  the  reference  map  rather  than  in  geometrical  distortions. 
There  were  available  several  high-resolution  pictures  (7.H  meters  per 
pixel)  of  downtown  Los  Angeles  taken  at  various  wavelengths  in  the 
visible  and  near-infrared  portions  of  the  spectrum,  and  it  was  clear 
that  one  of  these  pictures  could  serve  as  a "noisv"  reference  map  and 
the  other  as  a "corresponding"  sensor  map.  F.xperiments  with  the  two 
pictures  in  the  yellow  and  near-infrared  wavelengths  yielded  widelv 
varying  S/N  ratios,  with  a mean  of  1,2.  The  actual  Pearson  correlation 


! 


-4b- 


coefficient  (related  to  the  normalized  product  correlation)  between 
the  two  pictures  was  only  .Id,  despite  the  fact  that  the  two  pictures 
are  registered  identically  and  appeal  quite  similar  to  the  eye.  This 
last  observation  emphasizes  the  fact  that  judicious  feature  selection 
is  critical,  as  is  discussed  next. 

F(U’K  l-'XPHR  1 MKNTS 

It  has  long  been  recognized  that  careful  feature  selection  is  a 
key  to  effective  pattern  recognition.  In  conventional  pattern  recog- 
nition, feature  selection  (1)  reduces  t he  dimensional itv  of  the  space 
and  hence  the  quantity  of  computing  required  and  (2)  improves  the  ac- 
curacy of  classification.  Although  (1)  has  not  been  as  important  in 
this  work,  it  is  still  relevant;  item  (2)  is  of  obvious  significance. 
Several  different  kinds  of  very  preliminary  feature-selection  experiments 
have  been  conducted,  as  described  below. 

Edge  Detection 

One  of  the  most  obvious  kinds  of  features  to  consider  in  map  match- 
ing is  that  of  edges.  As  described  in  Ref.  1,  some  simple  edge  detec- 
tions were  tried,  using  various  gradient  and  Laplacian  operators.  The 
results  were  marginal,  probably  due  to  a combination  of  the  noisiness  of 
the  pictures  and  the  lack  of  sophistication  in  the  operators  themselves. 
More  recently,  the  Hueckel  operator^^  was  applied  to  some  of  our  pic- 
tures. Each  picture  was  covered  with  a set  of  non-overlapping  discs 
of  constant  diameter.  In  each  disc,  the  Hueckel  operator  finds  the 
best  "ideal  edge,"  that  is,  the  straight  line  in  the  disc  that  best 
separates  the  disc  into  two  parts  of  differing  pixel  value.  Such  an 
edge  can  have  any  orientation  and  any  location  within  the  disc,  and  in 
fact  these  values  are  outputs  from  the  operator.  A parameter  of  the 
Hueckel  operator  is  the  goodness  of  fit,  that  is,  the  degree  to  which 
an  edge  approximates  an  ideal  edge.  Experiments  were  conducted  with 
various  sizes  of  the  Hueckel  operator  and  values  of  the  fit  parameter. 

Two  outputs  are  shown  in  Figs.  10  and  11,  where  the  disc  size  was  five 
pixels  in  diameter,  i.e.,  a 5 * 5 square  with  the  corners  removed.  The 
field  boundaries  in  the  agricultural  region  show  clearly,  whereas  the 
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Fig.  10  — Hueckel  operator  applied  to  an  agricultural  scene 
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Fig.  11  — Hueckel  operator  applied  to  a suburban  scene 
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features  (including  roads)  of  the  suburban  scent  are  vague  for  the 
mos t pa r t . 

1 i experimented  further  with  Mueckel  operators  of  different 
sizes,  although  the  5 r>  square  seemed  best  for  our  purposes.  We 
also  tried  various  values  of  the  acceptance  threshold,  Tt  is  clear 
that  there  should  he  different  values  of  this  parameter  and  different 
sizes  of  the  disc  for  different  types  of  scenes,  and  that  these  param- 
eters can  be  deduced  experimentally.  However,  it  would  be  valuable  to 
have  dynamic  and  automatic  adjustment  of  these  parameters,  and  experi- 
mentation with  this  concept  seems  in  order. 

A disappointing  result  of  applying  the  Hueekel  operator  to  the 
vellow  and  infrared  suburban  scenes  was  that  the  correlation  between 
the  scenes  was  much  less  (.29  compared  with  .59)  after  such  applica- 
: ; • . i 1 : s implies  that  correlation  algorithms  such  i MAI  and  Prod  l 
would  not  work  as  well  after  using  the  Hueekel  operator.  However,  ad- 
justing the  acceptance  threshold  and  operator  size  might  we  1 1 improve 
these  results. 

Other  edge  and  shape  detectors  will  be  examined.  In  suburhan 
scenes,  for  example,  where  there  is  a good  estimate  of  road  width  (and 
even  orientation  in  some  cases),  specialized  detectors  that  use  this 
information  can  he  applied.  This  is  part  of  a larger  concept  in  which 
a whole  arsenal  of  techniques  is  used  to  extract  features  from  pictures, 
and  some  way  is  needed  of  reasonably  selecting  the  best  technique  for 
application  to  any  particular  picture  or  class  of  pictures.  The  more 
automated  this  process  can  become,  the  better,  although  .it  some  point 
the  problem  becomes  close  to  one  of  artificial  intelligence.  This 
point  is  raised  again  later. 

A Gradient  Appro.ii  h that  Ensures  the  Presence  of  features 

A particular  difficulty  in  depending  on  features,  as  above,  is 
that  a given  scene  may  not  contain  any.  Sensor  maps  are  usually  rather 
small,  and  it  is  quite  possible  that  in  relatively  featureless  areas 
the  operators  will  yield  nothing.  As  mentioned  before,  one  approach  to 
this  problem  is  to  modify  the  operator  threshold  or  size.  Another  ap- 
proach, whi,  li  has  been  briefly  tried,  is  to  ensure  features  hv 
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associating  with  each  point  some  function  of  it  and  its  neighboring 
points,  such  as  the  simple  gradient  or  f, apiarian.  Spec  if iral 1 y,  the 
scheme  associates  with  each  point  of  a picture  a vector  of  eight  value  , 
obtained  as  follows.  Divide  the  9 • 0 square  of  which  the  given  point 
is  the  center  into  four  5 ■ 5 quadrants  (the  edges  overlap).  Then 
compute  a smoothed  gradient  for  each  of  these  quadrants,  with  the  ori- 
gin at  the  center  of  each.  Since  each  gradient  has  an  x-value  ind  a 
y-value,  there  is  a vector  of  eight  values  far  each  point  in  t lit*  sensor 
scene.  Such  a vector  obtained  from  a sensor  scene  < in  be  impared 
the  corresponding  stored  (or  computed)  vectors  for  each  point  of  a ref- 
erence scene.  The  match  point  is  determined  to  be  that  for  which  the 
associated  reference  vector  is  closest  to  the  sensor  vector,  where 
"closest"  can  be  any  of  a number  of  measures,  including  Euclidean  dis- 
tance, sum  of  the  absolute  deviations,  minimax,  or  other.  Preliminary 
tests  actually  gave  poorer  results  in  a simulation  (ID  correct  matches 
out  of  100,  compared  with  h‘>  out  of  100  for  MAD),  hut  clearly  there  is 
an  opportunity  to  try  different  gradient  sizes  and  different  decision 
rules  about  vector  comparison.  Second-derivative  information  and  other 
measures  such  as  the  goodness  of  fit  of  a Hueckel  operator  might  also 
be  used. 

Features  Based  on  Entropy 

The  amount  of  information  conveyed  hv  parts  of  a scene  seems  to 
he  a plausible  quantity  on  which  to  base  feature  selection,  and  indeed 
a measure  based  upon  entropy  considerations  (direct lv  related  to  infor- 
mation) is  sometimes  used  in  ordinary  pattern  recognition.  A simple 
entropy  calculation  that  was  tried  consisted  of  replacing  the  center 
point  of  a 5 * 5 square  by  the  average  information  conveyed  by  tin* 
points  in  this  square.  Tills  is  done  by  counting  the  frequency  of  pixel 
values  among  the  25  points.  We  regard  these  frequencies  as  probabili- 
ties, i.e.,  if  a particular  pixel  value  i occurs  K times,  its  empirical 
probability  of  occurrence  is  p^  = K/25.  Then  the  total  information  Is 


Pj  l»K  1>  j 
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This  calculation  was  made  on  the  original  suburban  scene,  after  which 
correlation  was  simulated.  The  results  were  again  worse  than  those 
for  the  original  MAD  algorithm  ( 111  versus  h'l  cases  out  of  100)  for 
S/N  l with  a 1 ■ 5 sensor  scene  and  a IS  ■ IS  reference  scene.  More 
judicious  aggregation  into  classes  or  more  elaborate  information  valua- 
tion (such  as  the  concept  of  mutual  information  adapted  for  this  situa- 
tion) might  improve  these  results. 

It  is  worth  noticing  that,  unlike  most  of  the  other  features  dis- 
cussed here,  entropy  is  a function  of  the  distribution  of  pixel  values 
rather  than  a direct  function  of  the  values  themselves.  As  such,  it 
represents  another  class  of  features  and  gives  further  insight  into  the 
various  kinds  of  features  available. 

Features  Based  on  the  Kstimated  Value  of  l’c 

Yet  another  approach  to  feature  selection  has  been  tried.  In  this 
new  technique,  for  a given  number  of  elements  (feature  sine)  to  he 
chosen  from  the  sensor  map,  all  possible  submaps  contained  in  the  sen- 
sor map  are  created.  Kach  submap  is  then  compared  with  the  reference 
map  using  the  correlation  process;  the  match  position  and  correlation 
statistics  are  simultaneously  determined.  The  Gaussian  theory  then 
relates  the  statistics  of  the  correlation  process  (expected  value  and 
variance  of  the  in-  and  out-of-register  values  of  the  correlation  func- 
tion) to  the  scene  parameters  (variance  of  the  scene  intensity,  variance 
of  the  noise,  and  number  of  independent  elements  in  the  scene).  Bv 
using  these  relationships,  it  is  possible  to  derive  all  the  information 
necessary  for  estimating  , as  described  in  Sec.  IV.  Having  developed 

a technique  for  estimating  P for  each  submap,  it  is  now  possible,  bv 

c 

ranking  the  submaps  relative  to  the  P^  measure,  to  determine  the  fea- 
tures (sets  of  points  contained  in  the  submap)  that  are  most  signifi- 
cant in  the  scene. 

One  brief  experiment  has  been  performed  that  illustrates  this  con- 
cept and  offers  some  encouraging  results.  Taking  a verv  small  simulated 
reference  and  sensor  scene,  it  was  attempted  to  determine  the  relative 
importance  of  each  of  the  sensor  points  in  making  a potential  match. 

This  was  done  in  two  ways:  One,  through  a direct  simulation  with  noise 
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added,  resulted  in  what  is  here  called  an  "observed  I’  the  other, 

c 

through  the  closed-form  approximation  described  above,  yielded  an 
"estimated  !’ 

c 

The  reference  scene  chosen  was  t lie  following  7 ■ 7 "manufactured" 
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Fig.  12 — ’Manufactured"  reference  scene 

It  has  an  ill-defined,  approximately  vertical  streak  that  might  be 
termed  a "road."  The  center  3 * 3 portion  of  this  scene  was  extracted 
and  approximately  500  different  samples  of  Gaussian  noise  were  added 
to  each  of  the  cases  formed  by  deleting  exactly  one  point.  The  noise 
was  multiplied  by  the  appropriate  factor  with  the  MAI)  algorithm  to  give 
a S/N  ratio  of  1 for  one  set  of  cases  and  a S/N  ratio  of  3 for  another 
set.  The  reduced  3 * 3 square  (with  noise  added)  was  then  superimposed 
in  all  possible  positions.  The  "observed  P " in  Table  21  is  the  number 
of  times  the  MAI)  algorithm  yielded  the  correct  match  (with  S/N  = 1) 

divided  by  the  total  number  of  cases.  The  "estimated  1’  " is  the  value 

c 

calculated  following  the  procedure  described  in  Sec.  IV. 

The  results  show  that  single-point  deletion  in  general  has  little 
effect,  with  the  possibly  significant  exceptions  that  results  were 
better  when  one  particular  point  was  deleted  (8  or  1,  depending  on 
which  method  was  used),  and  that  they  were  definitely  worse  when  another 
was  deleted  (9  or  2).  The  latter  result  indicates  that  point  9 (or  2) 
is  the  most  "significant"  in  contributing  to  the  correlation  value. 

The  experiment  was  repeated  deleting  all  possible  part’s  of  points. 
The  results  were  similar  but  more  pronounced  than  for  the  single-point 
situation;  they  are  shown  in  Table  22.  A particular  pair  of  points 
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Tab  le  21 

I 11  i CIS  01'  SINC  1,1  -1’OIN'I  1)1 1,1  I ION 


Point  Deleted 

r 

Observed  V 

C 1 

hstinuited  P 

c 

H 

0.617 

0.670 

1 

0.  58  5 

0.  740 

u 

0.  L> 7 7 

0.666 

7 

0. 569 

0.6  58 

h 

0.  565 

0.694 

3 

0.550 

0.688 

2 

0.538 

0.611 

b 

0.529 

0.649 

0.468 

0.6  35 

N< ■ delet  ion 

0.591 
_ J 

! 

NOTE:  St'iisor  scene  points  are  numbered 

as  fol lows : 


1 2 3 
A 5 b 
7 H 9 


(5,  9)  was  found  to  he  the  most  important  using  the  simulation  method, 
and  (2,  9)  was  the  most  important  in  the  estimation  approach.  In  both 
cases,  the  pair  of  points  chosen  were  the  two  highest  in  impo’  tance  in 
the  corresponding  single-point  experiment. 

A comparison  of  the  two  sets  of  results  provides  a crude  measure 
of  the  "goodness"  of  the  approximation  approach.  The  estimated  P^ 
values  are  all  higher  since  no  noise  was  added,  but  this  is  less  impor- 
tant than  the  rank  ordering.  It  is  seen,  for  example,  that  the  two 
least  Important  pairs  are  the  same  in  both  approaches  (though  inter- 
changed in  order);  the  ordering  at  the  upper  end  is  not  quite  as  con- 
sistent, although  the  same  general  trend  is  evident.  The  complete  rank 
difference  correlation  coefficients  .ire  given  in  Table  2). 

This  experiment  has  demonstrated  in  a crude  way  the  concept  of 
selecting  features  on  the  basis  of  their  P values.  In  principle,  ot 
course,  we  would  continue  the  process  of  eliminating  triplets,  quad- 
ruplets, and  so  forth,  of  points  from  a real  scene  in  the  search  for 

"features"  that  make  significant  contributions  to  P . Presumably,  after 

c 

a simple  start  as  shown  above,  we  might  avoid  the  theoretical 
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Tabl p 2) 

HANK  CORRF.LAT I ONS  IN  POINT  DELETION  EXPKRIMENTS 


Number  of 

Points 

De  let  ed 

Quantities  to  be  Rank-Correlated 

1 

2 

Estimated  F versus  observed  F for  S/N  = 1 

c c 

0 . 65 

0.  76 

Estimated  F versus  observed  F for  S/N  = i 

c c 

0.4  7 

0.  54 

Observed  F *s  for  S/N  = 1 versus  S/N  = 3 

c 

0.6  5 

0.61 

requirement  to  examine  all  possible  combinations  of  points,  concentra- 
ting instead  only  on  those  combinations  that  contain,  for  example,  the 
best  third  of  the  smaller  sets.  This  is  but  the  germ  of  an  idea;  how- 
ever, the  modest  success  achieved  at  this  point  indicates  the  desir- 
ability of  more  extensive  similar  experiments  in  the  future. 

CONCLUSIONS 

'Two  conclusions  can  be  drawn  from  the  three  unsuccessful  experi- 
ments. The  first  is  that  too  simple  and  naive  an  application  of  con- 
ventional feature-selecting  algorithms  is  not  often  adequate  when 
dealing  with  images  of  real  terrain.  Those  successes  that  have  been 
demonstrated  by  others  should  be  recognized  as  the  result  of  quite 
sophisticated  and  extensive  efforts.  The  second  and  more  important 
conclusion  is  that  all  feature-selection  algorithms,  whatever  their 
degree  of  success  in  achieving  matches,  should  he  conscientiously  com- 
pared with  the  more  conventional  correlation  alternatives  for  (a)  ac- 
curacy, (b)  gross  error  rate,  and  (c)  cost  in  terms  of  computing  effort. 

The  fourth  approach,  based  on  the  use  of  P , is  considered  promis- 
ing and  further  experimentation  is  recommended. 


4 


VI 


IDEAS  I- OK  FUTURE  WORK 


Three  of  the  approaches  described  in  Sec.  V tailed  in  their  iirst 
implementation.  They  will  be  pursued,  by  adjustment  of  parameters  or 
more  sophisticated  refinements,  until  either  they  are  made  to  work  or 
their  failure  is  better  understood.  In  addition  to  the  feature  selec- 
tion based  on  P , there  are  at  least  two  other  techniques  to  be  con- 
sidered. 


IMPROVING  CORRELATION  SYSTEMS 

Figure  11  shows  the  layout  of  a typical  correlation  processing 
scheme  in  which  sensor  data  are  fed  through  a preprocessing  operation. 
This  operation  may  have  many  functions,  including  "grey  level  coding" 
of  the  data,  feature  extraction  via  pattern  recognition  techniques, 
and  scene  enhancement  via  either  global  (e.g.,  histogram  equalization, 
lourier  transformation,  etc.)  or  local  operators  (e.g.,  gradients, 
hup  lac  inns,  etc.).  Once  these  sensor  data  are  preprocessed,  they  are 
led  into  a processor  where,  by  means  of  a correlation  algorithm,  the 
match  position  and  the  location  of  the  sensor  map  relative  to  the  ref- 
erence map  are  determined. 

One  of  the  major  problems  associated  wivh  this  formulation  of  the 
correlation  process  is  that  if  the  match  position  (selected  on  the 
basis  of  some  metric  exhibiting  an  extremum)  does  not  fall  in  the  re- 
gion surrounding  the  true  match  position,  the.  correlator  will  fail.  It 
would,  therefore,  be  very  desirable,  in  addition  to  determining  the 
"match  position,"  to  also  determine  a confidence  measure  on  which  to 
base  a determination  that  this  is  the  true  match  position.  The  prob- 
ability of  correct  iock-on,  P , provides  such  a measure.  However,  its 
computation  until  now  was  a complicated  calculation  that  was  not  obtain- 
able in  a closed-form  expression.  Section  III  has  provided  a "good 
approximation"  method  for  obtaining  P in  a closed-form  expression. 

This  development  has  led  to  a reconfiguration  of  the  correlation  pro- 
cessor . 

Figure  \/*  shows  the  proposed  correlation  scheme.  It  differs  from 
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t hi'  present-day  schemes  primarily  in  that  an  estimation  process  and  de- 
i i s i an  criteria  are  included  in  the  overall  operation.  The  lum  t ion 
t tin  estimation  process  is  to  determine  from  the  correlation  data 
what  the  scene  statistics  were  (variance  of  the  scene  intensity  and 
variano  of  the  noise)  and,  based  on  these  statistics,  what  ur>  the 
best  estimates  of  the  S/N  ratio  and  the  probability  of  corret  t lot  k-on. 
Two  assumptions  are  made  in  this  estimation  process.  first,  it  is  as- 
sumed that  the  scene  statistics  are  Gaussian.  The  effects  on  this 
estimation  process  of  non-Gaussian  scene  statistics  have  been  tested 
hut  need  mort  simulation  using  real-scene  imagery  data.  Second,  it  is 
assumed  that  error  sources  other  than  additive  noise  (geometric,  in- 
tensity scaling,  etc.)  are  controlled  to  such  an  extent  (by  placing, 
tolerance  limits  on  design  parameters)  that  they  do  not  significantly 
alter  tin  estimates  obtaine1  for  P or  S/.N.  This  assumption  will  also 
be  tested  using  a simulation  process. 

The  estixatt  ot  the  S/N  ratio  can  be  valuable  in  selecting  the 
, riper  algorithm  for  the  next  correlation  update  and  possibly  enhancing 
the  performance  of  the  preprocessing  operation.  The  estimate  of  P is 
important  from  two  standpoints.  Most  importantly,  it  can  be  useful  in 
deciding  whether  the  match  position  obtained  via  the  correlation  pro- 
cess is  tin  true  match  position  or  not,  and  consequently  whether  the 
correlator  should  remain  in  the  acquisition  mode  or  should  switch  over 

to  track  mode.  Second,  if  P is  quite  high,  then,  in  addition  to  de- 

c 

riding  to  switch  to  a track  mode,  it  would  be  possible  to  reduct  the 
search  area  (which  would  free  the  computer  to  process  out  other  error 
sources  in  the  track  mode);  or,  if  P is  low,  then  the  search  area  might 
either  remain  fixed  or  possibly  be  expanded. 

The  success  of  this  formulation  of  the  correlation  process  depends 
on  two  conditions,  namely:  (1)  that  the  two  aforementioned  assumptions 
(Gaussian  statistics  and  limited  geometrical  errors)  do  not  severely 

A A 

degrade  the  estimate  of  P and  S/N  and  (2)  that  the  variance  of  these 
estimates  is  small  enough  to  render  them  useful. 

A A 

Methods  for  estimating  P(  and  S/N  from  the  data  have  been  formu- 
lated. Initial  analysis  on  the  S/N  estimate  has  shown  it  to  have  a 

A 

relatively  "tolerable"  variance.  Analysis  on  the  variance  of  P and 


-hO- 


testing  these  ist  im,u  ion  techniques  using  simulation  In  mique.  remain 
to  b»-  done. 

ART  IK  1 C I A1  1 NT  11  l.ltdlN  Cl . 

Artificial  intelligence  was  mentioned  in  Sec.  V,  and  is  discussed 
briefly  here  even  though  the  precise  level  of  application  is  not  clear 
at  this  time. 

mman  per  terms  mu;  matching  by  bringing,  i t sssary,  ... 

amount  of  prior  knowledge  to  bear  on  the  problem;  additionally,  .any 
specialized  receptors  in  the  eye  and  subsequent  visual  interpret  at io 
in  the  brain  are  powerful  front-end  processors.  To  simulit<  these 
processes  directly  is  far  beyond  the  state  of  the  art;  in  fact,  if  t 
could  be  done,  a significant  part  of  the  artificial  intelligence  ,t  ;- 
1 cm  would  be  solved  and  a new  computer  revolution  would  b<  at  hand. 

Nevertheless,  techniques  from  the  emerging  computer  s-  ience  dis- 
cipline of  artificial  intelligence  can  be  applied  to  map  matching, 
have  already  mentioned  edge  detection.  One  subject  within  artificial 
intelligence  describes  the  ways  in  which  edges,  lines,  corners,  and 
other  primitives  are  put  together  to  form  recognizable  objects.  The 
analyst  then  mate  lies  these  descriptions  rather  than  the  objects  them- 
selves. 

Of  ultimate  importance  in  artificial  intelligence  is  a "world 
model"  that  ties  together  a large  amount  of  information  about  how  real- 
world  scenes  of  interest  are  constructed  and  how  their  subparts  are 
related.  It  is  a higher-order  synthesis  than  that  described  above, 
lor  example,  statements  like  "a  large  river  always  ends  at  an  ocean" 
and  "freeways  never  dead-end"  are  common-sense  facts  that  people  "know" 
but  an  artificial  intelligence  computer  has  to  be  told.  Determining 
what  statements  are  important,  how  to  put  them  into  an  appropriate  in- 
formation structure,  how  to  relate  the  statements,  and  how  to  access 
and  manipulate  the  information  are  all  major  considerations  in  artifi- 
cial 1 nt el  1 igence. 

Artific  lal  intelligence  programs  are  generally  heuristic  in  nature, 
meaning  that  they  try  a number  of  plausible  chains  of  reasoning  in  at- 
tempting to  solve  problems,  and  may  back  up  and  re-try  several  times 
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in  the  | i ( < ■ . ! •.  map  matching,  t * • r • >n  ; 1 « , sucl  programs  could  form 

uvpothcses  about  tlic  correct  match,  and  then  re  j c*  t tin  livpotheses  nr 
test  them  further  based  on  information  in  the  stored  world  model. 

Sin  h artificial  intelligence  programs  are  large,  complex,  t ime- 
consii!  in,  to  run,  and  expensive.  These  attributes  may  make  them  ira- 
, : .1.  t i.  a 1 for  use  in  the  real  world  of  target  acquisition.  However, 
tin  decreasing  eost  and  size  of  computers  and  the  increasing  under- 
funding  of  irtificial  intelligence  may  make  such  solutions  feasible 
within,  say,  the  next  decade  or  less.  1 ven  it  other  cost-et  f e.  tivi 
methods  are  found  in  the  meantime,  an  appreciation  of  the  philosophy 
and  techniques  ot  artificial  intelligence  may  lend  some  insight  and 
direction  into  mort  conventional  appr  u-hes. 
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Append ix 

P ST  I MAT ION  01  THE  S/N  RATIO 


Ph  is  appendix  describes  a method  tor  estimating  the  S/N  ratio 
1 sm  the  correlation  data,  using  either  the  MAO  or  the  Product  algorithm, 
and  determines  the  standard  deviation  of  these  estimates.  It  is  noted 
that  the  estimates  derived  using  the  Product  algorithm  assume  no  spa- 
tial correlation  in  the  scene,  i.e.,  all  map  pixels  arc  assumed  to  be 
independent  (or  N must  be  interpreted  as  the  number  of  independent  ele- 
ents).  The  estimates  using  the  MAD  algorithms  are  also  correct  (un- 
biased), iespite  tiie  difficulty  with  N for  this  algorithm  tiiat  is  dis- 
cussed in  Sec.  IV,  since  t lie  two  equations  that  involve  N [Kqs.  ( A—  1 •) 
and  (A-lti)]  do  not  have  to  be  used. 

ij  riMATiNC.  I UK  S/N  RAT  1 U l S 1N(.  PKODPCT  Al.COKlThM  DAI  A 

Statistically,  for  t he  Product  algorithm,  the  following  relation- 
ships hold  true: 


F.  { 4 ( 0 ) ) = a1 

X 


o2(0) 


(A- 1 ) 


(A-2 ) 


F.{  4 (J ) ) = 0 


2(J) 


(A-  1) 


(A-A) 


From  the  correlation  data,  estimates  for  three  of  these  quantities 
can  be  obtained  as  follows: 


Fi 4(0)1  The  value  of  the  correlation  function  at  the  match 

position,  4».(0),  can  serve  as  .in  estimate  of  this 

M 

quantity.  Since  there  is  (generally)  only  one  match 
point,  there  is  no  way  of  estimating  ‘(0). 


IKhCLUlNO  PALIS  hfJtMUhOT 


/ 
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FlJ(.I)  Tin-  mi’. in  of  the  measured  out-of-register  values  of 

the  correlation  function  can  serve  as  the  estimate  of 
this  quant  i t y , i . e . , 

i) 

k 

E-  ,(  I ) T..<  I ) (A-  >) 

V1  M 

l - 1 

) 

*“(J)  This  quantity  can  be  estimated  by 

() 

V,)  n E [;M(  ,)  ' V ' ] ’ MU)  (A'h) 

I I 


The  S/N  ratio  per  se  does  not  come  directly  from  these  three 

values,  but  and  “ can  be  estimated  separately  and  then  the  ratio 
x n 2 

formed.  It  has  been  suggested  that  ^ can  be  measured  by  using  only 
the  portions  of  the  reference  map  that  correspond  to  the  sensor  map. 
However,  when  we  consider  that  with  "live"  imagery  botli  maps  have 

noise  superimposed  on  them,  it  becomes  apparent  that  this  is  not  a 

2 

satisfactory  approach.  Our  approach  is  to  (1)  estimate  ‘ from  lq. 

-'2  2 X 
( A- 1 ) , i.e.,  o = T,(0);  (2)  with  this  estimate  of  solve  Fq . (A-s) 
x M , x 

for  an  estimate  of  and  finally  ( ))  form  the  ratio  of  these  two 

quantities  to  obtain  the  desired  estimate.  The  result  is 


/s  /X  2 ) 

S/N  * o /<) 
x n 


» yj> 


- 1 


(A- 7) 


The  variance  of  this  estimate  can  be  approximated  in  terms  of  the 
variance  of  (J)  and  i>(0)  by  using  a Taylor  series  expansion  of  b.q. 
(A-/),  dropping  terms  higher  than  first  order  and  forming  the  expected 

A 

for  the  Produi  t algorithm,  this  quantity  is  not  measured  but  as- 
sumed by  the  statistical  model  to  be  zero. 


t 
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* 

v.ilm  ot  tin  square  ot  tlii'  change  in  tin-  S/N  ratio.  The  interesting 
gene i > 1 1 I urmu 1 a is  t ha t 


Vnr  I ( X , V) 


(A-*  ) 


which  in  this  case,  i.e.,  tor  F = Eq . (A-/),  yields  the  result 


Var  (S/N ) 


N 


"(_•>.) 

(0) 


r 

U2(o). 


V.ir 


-(.I) 


-Vo 

;’(()) 


V.  i r : ( 0 ) J 

(A -in 


~ 7 

The  variance  of  q(U)  is  simply  "(0),  which  can  he  obtained  from 

A 

Eq.  (A-2).  Obtaining  the  variance  of  ’(J)  is  somewhat  more  complicated, 

.f 

but  for  large  values  of  Q (Q  _■  30),  a close  approximation  (attributed 
to  W.  K.  Chow  of  Rand)  is 


■k 

The  expected  values  of  A<J>(0),  Ao(J)  are  taken  to  be  zero  and,  with 
; (0)  independent  of  (J),  the  expected  value  of  the  product  ,';(())  (J) 

is  also  zero. 

With  o'  (J)  given  by  Eqs.  (A-3)  and  (A-6), 


0 

- 

0 

2 

1) 

1 

Q 

E 

id) 

1 

M 

; (K) 

! = 1 

- 

K = 

- 

- 

•j 

1 ) 

1 

t) 

E 

;( i ) 

- T(K) 

i = i 



where  ;(K)  represents  the  mean  value  of  the  out-of-register  correla- 
tion function  (taken  to  be  zero  for  the  Product  algorithm)  and  q ( I ) 
is  assumed  to  be  distributed  N[0,  o 2 ( j ) ] . n2(j)  js  tiien  chi-square 

distributed  with  Q-l  degrees  of  freedom.  Thus, 

0 - 2 

Eiid)  - .1.^11-  _ 2 
2/lS  <)-l 

ii  0 (J) 

where  ' ‘ ( I ) i needed  1 1)  I lie  del  I mu  I ll.lt  nr  to  give  the  ( I ) variables 
a unit  var  i am  e.  (liven  that 


7 


-6f>- 


- 0 (J) 

Var  o(J)  = -j~- 


( A- 1 0 ) 


Equation  (A-9)  can  now  be  written  as 


Var  (S/N) 

1 (')  N . , 


i > r > ? 

U I)  “ > (!)  + “( 

4 20  2, 

( o > J L ;■  ( 


'>  ,2(0) 


r 2 , 2 . . 

Expressing  this  in  terms  of  • and  ^ results  in 


/a^\/o2  \ / , , 2 + a2/  '2 

T < / x \/  x . \ I 5 . n x 

Var  S/N  - A I — \\  — + 1 J I — + £ 

\ n / \ n / \ 


(A-Ll) 


Var  (S/N)  - 4<S/N)2  [ 1 + (S/N)]2  * 2 * ] <*-121 


Var  J 2xi  . = 1 - 1 - ' > + order  terms 

V (<  1 4«)-l)  8 ( Q- 1 ) 

the  v.ir  V,1^(-1)  Is  found  to  be  approximately 


Var  0(1) 


Var  O(.I) 


) = Var  ]/  • 2X2_, 

q2( j>  r,  _ , >. i l 

2Q  [ 4 (Q- 1 ) 8(Q-irJ 


For  reasonably  large  values  of  (),  this  reduces  to 


Var  o(.l) 


o2(.l ) 


r 


-h7- 


Tahle  A-l  shows  some  values  of  the  variance  of  the  estimate  for 
tin  range  of  S/.N  ratios  of  interest.  As  seen  in  this  table,  for  S/N 
ratios  above  1,  the  estimator  has  too  large  a variance  to  be  of  any 
practical  use. 


Table  A-l 

VARIANCE  OF  THE  ESTIMATE  OE  THE  S/N  RATIO  USING 
THE  PRODUCT  ALGORITHM  FOR  Q = 250  and  N = 100 


Ac t ua 1 S/N 

' 

Variance  S/N 

Standard 
Deviation  S/N 

0.  t 

0.0059 

0.077 

1 

0.512 

0.72 

5 

86 . 4 

9.  30 

10 

1113 

3 3.4 

ESTIMATING  1 HE  S/N  RATIO  USING  MAD  ALGORITHM  DATA 

For  the  MAD  algorithm,  the  following  relationships  statistically 
hold  true: 


i:U(0)>  = V 2/n 


0 (0)  = (1  - 2/tt)  o /N 
n 


e4u)  ) 


= VTFfal  + ol) 

(2o2  + a2) 

\ x n/ 


o (.1)  = (I  - 2/11) 


(A-l 3) 


(A-l A) 


(A-l S) 


(A- lb) 


Estimates  of  E{<P(0)},  F.{<P(J)I,  and  02(J)  can  be  obtained  from  the  data 
as  described  in  the  previous  subsection  of  this  appendix.  Again,  there 
is  no  way  to  directly  estimate  the  S/N  ratio,  but  it  must  be  obtained 


4 
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2 2 

1 v estimating  and  “ separately  and  then  taking  the  ratio.  The 
, x n 

est  imate  of  ' is  given  hy 

n 

Hi)  (A- 1 7) 

n ‘1 

Table  A-2  shows  some  values  of  the  variance  of  the  estimate  for 
Lite  same  S/N  ratios  .is  are  shown  in  Table  A- 1 . As  can  be  seen,  for 
S/N  ratios  around  0.1,  the  Product  algorithm  provides  a better  estimate 
of  the  S/N  ratio;  but  for  the  S/N  ratios  in  the  range  of  general  in- 
terest (0.S  to  5),  the  MAI)  algorithm  provides  the  better  estimate.  The 
standard  deviations  of  the  estimates  appear  to  be  small  enough  (from 
Table  A-2)  that  this  technique  can  be  considered  a useful  means  of 
estimating  the  S/N  ratio. 


Table  A-2 


VARIANCE  OF  THE  ESTIMATE  OF  THE  S/N  RATIO  USING 
THE  MAD  ALGORITHM  FOR  Q = 2S0  AND  N = 100 


A<  t ua  1 S /N 

V.i r i .m<  f S/N 

St  andard 
Deviation  S/N 

0.  1 

0.0164 

0. 1 2H 

I .0 

0.  1026 

0.  U 

') 

1 . (K 

1.17 

10 

..OI 

) )/. 

ESI  1 MATING  THE  S/N  RATIO  i.SINO  LOTH  MAI)  AND  PRODUCT  ALGORITHM  DAI  A 

If  both  algorithms  are  used  in  the  correlation  process,  a simple 
estimation  for  the  S/N  ratio  would  be 


S/N 


> > 

r hr 


x n 


[((())]  Product 
, [;■  (())]  MAO 


The  variance  oi  this  estimator  is 


(A- 1 «) 


r 


j 


Var  S/N  ( ' (S/N)  [ 2 ( it-  1 ) ( S/N)  +■  1| 

\ N 


(A-19) 


Table  A-3  shows  that  the  variance  of  this  estimator  is  similar  to  that 
of  the  MAD  estimator,  but  is  somewhat  better  in  all  cases.  Equation 


Table  A-3 

VARIANCE  OF  THE  ESTIMATE  OF  THE  S/N  RATIO  USING  BOTH  THE 
MAD  AND  PRODUCT  ALGORITHM  DATA  FOR  Q = 250  AND  N = 100 


Actual  S/N 

- 1 

Variance  S/N 

Standard 
Deviation  S/N 

0. 1 

0.0014 

0.0  17 

1 

0 .053 

0.23 

5 

1.11 

1 .05 

10 

4.37 

2.09 

(A-16)  cannot  be  used  since,  as  discussed  in  the  main  text,  N does  not 
represent  the  number  of  independent  samples.  Never theiess , an  estimate 
of  C2  can  be  obtainted  using  Eqs.  (A-15)  and  (A-17),  with  the  result 
be  ing : 


a2 


<i>  (.!) 


- 


] 


where  (J)  is  defined  in  Eq.  (A-5). 
M 

It  follows  that 


S/N 


0 

x 

-2 

a 

n 


»M<J> 


(A-20) 


The  variance  of  this  estimate  can  be  found  in  a manner  similar  to  that 
described  for  the  estimate  obtained  using  the  Product  algorithm.  The 
result  is 
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r _ -| 

2 

r _ - 

? 

Var  (S/N)  = 

p 

_4>  (0)_ 

<f  ( .1 ) 

Var  ♦(.!)  + 

Var  <1(0) 

whii'h  equals 


Var  (S/N) 


(A-21) 


( A- 2 2 ) 


2 2 

In  terms  of  and  ' , this  ran  ho  written  us 

x n 


Var 


(A-23) 


or 

Var  (S/N)  = * [2(S/N)  + i] 


(A- 24) 


This  estimator  appears  to  yield  reasonably  good,  unbiased  estimates  of 
the  S/N  ratio  and  correct  estimates  of  its  variance,  even  when  spatially 
correlated  data  are  used. 


r 


. 
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